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SUMMARY 

The major purpose of any quality control stu^^foust be * the improvement of 
quality or reduction of error through the identif icati^Kselectior), and implementation 
of corrective actions. As noted in Quality in the Pen|ifcant Delivery System: Volume 
1, Findings, the level and extent of error are evidence for ths continuing development 
of corrective actions. On average, Pell Grant recipients in 1982-83 were granted 
$129, or 13 percent mote than they should have been-^-a 24 percent decrease in 
average net overaward from 1980-81. Over 62 percent of the aid recipients received 
awards in error by more than $2 and over 42 percent had award errors in excess of 
$100. In all, an estimated 1 million Pell Grant recipients were overawarded 
$465 million, while an estimated 500,000 recipients were underawarded $139 million. 

In this volume, two themes are used in developing corrective actions for six 
specific application errors: « 

V . . . 

• Targeting validation toward the types of students or types of error that 
would have the highest payoff. This, is a form of remedial corrective 
actij^ 

• Improving the application form by either clarifying^ definitions or 
requesting clarifying information. This is a farm of preventative 
corrective action. y 

Applying these two themes to the six selected application errors yielded the 
following specific recommendations: 



Recommendation 3.1: 



In order to reduce dependency status errors we 
recommend expanded validation of first-time 
independent applicants and tightened procedures and 
documentation requirements. 



Recommendation 3.2: To. i reduce error in reporting nontaxable income we 

recommend that the required components be itemized to 
minimize accidental omissions and that the validation 



Recommendation 3.3: 



Recommendation 3Ai 



'Recommendation 3.5: 



" - • ) ' 

selection process be modified 'to,.* select those cases 
where, other income sources are suggested by family 
demographics. s ' ' ^ ? ^ # 

We encourage additional^ training* opportunities (work- 
shops and written materials) to instruct financial £id' 
personnel on how to read tax returns' and similar dcfcu- 
mentatioh which can be useful \x\> identifying correct 
amounts of income from thfese sources. We also urge the 
Department to explore additional data matches with the 
agencies providing these benefits, as a means of automa- 
ted validation on the "front end." ' 3 ' ' 

To reduce error in reporting household size .we recom- 
mend pursuing improvements in the application and 
instructions to increase the accuracy of reporting by 
listing the family members being included in household 
size. • > 

We recommend that the Department give consideration 
to replacing prospective household size with number, of 
tax exemptions. 

To improve the accuracy of the multiple student allow- 
ance we recommend changing the .application to/require 
listing the names of all household members in post- 
secondary education: In addition, the issue of whether 
parenfs\ should or should not be included needs to be 
clearly defined in the application instructions. 

To improve the reporting of Adjusted; Gross Income we 
recommend that the application and instructions specify 
that, to the extent possible, the applicant should 
complete their Pell Gi^ant application after completing 
their or their, parents 1 Federal tax forms. 

We recommend that validation selection be evaluated, 
revised, and monitored as a regular processing year 
event. 



Recommendation 3.6: To reduce error associated with incorrect reporting of 

dependent student incorpe we recommend that the 
Department validate tf)o$e applicants whose projected 
incorrte drops to less, than half of base year income\by 
requesting the student's tax form, 



In addressing four specific institutional errors, the following ^two themes were 
utilized: ^ • 



Simplifying procedures and policies, &r example, enrollment status regula- 
tions and the payment-schedule , 



• j Putting more emphasis on the* institution as the focus of quality .control, 

, - * 

The four specific recommendations which derive from these themes concerning 
specific institutional errors include; 



Recommendation 3.8: 



Recommendation 3.7: To reduce error attributable to enrollrnent status report- 
V }\ ing we recommend that the Department solicit extensive 

* comment from all interested parties as part of the 

normal rulemaking process on the date-certain approach 
and 6n the impact of various alternative cittoff dates. 

T6 irpprove the accuracy of cost of attendance reporting 
we recommend instituting a more structured cost of > 
attendance formula which realistically reflects average 
student circumstances at different types of schools. 

Regardless of the formula used, we recommend that 
comment be solicited from all interested parties on the 
establishment of a cutoff date for cost of attendance set 
by each school. # 

Recommendation 3.9: To improve the accuracy of award calculation and 

disbursement we recommend that an individualized pay- 
* ment schedule be included on a revised format for each 

official SAI. " * 

* 

Recommendation 3.10: To eliminate confusiqn and error associated with missing 
* financial aid transcripts we recommend consideration of 

a proposal to drop the FAT as a Pell eligibility require- 
ment now that aggregate award limits have been . eased, 
except perhaps for Mthin-year transfers. n 

We also Recommend that 



the aid administrator be 
FAT in the student's file if 
a hardcopy cannot be obtained after reasonable effort. 



permitted, to place a "proxy" 



The above specific recommendations are augmented by five broad-based 
recommendations which also derive from the above themes for institutional and 
application errors. These recommendations for further improving the delivery of Pell 
Grant funds include: » . 



Recommendation^.!: Development of a suitable "split form." We. also 

recommend that the instructions and specifications for 
the following items be augmented: 

— other nontaxable income * 

— household size 

— number in postsecondary education. x 
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Recommendation 4.2: 



Recommendation 4.3: 



Recommendation 4.4: 



Recommendation 4.5: 



Substitution of "own residence" , and "self support" 
criteria for the current parental "residence and support 
criteria as a means of fmproving the ability, to document 
and verify dependency status. ' 

Evaluation of each item in the family contribution 
schedule as to its impact on award size and distribution' 
as well as its reliability, sensitivity, and ease of valida- 
tion. 

* * *■ 

Establishment of a cutoff date for student-Initiated 
corrections for all applicants. For validated applicants, 
no further corrections would be permitted after valida- 
tion. 

Establishment of the institution ■ as the quality control 
focal point by developing regulations, providing incen- 
tives, and providing technical assistance. In addition, 
the Department should assume the quality assurance 
function.. 
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CHAPTER 1 
INTRODUCTION 



s 
f 



A quality control study has three major purposes: to measure the level of error, 
to determine probable causes, and to develop and assess alternative corrective actions. 
The 1982-83 Pell Qrant Quality Control Study has been conducted with those purposes 
as the cornerstone of all related activities. The final report also reflects this triad of 
purposes in its organization and presentation. Th$ study findings with respect to levels 
of error and probable causes are presented in Volume 1, Findings . This volume, 
Corrective Actions , examines the management factors associated with this error and 
recommends corrective strategies. An accompanying third volume, Procedures and ^ 
Methods , describes the procedures used to collect, process, and analyze the data which 
produce the error findings. J 

In this introductory chapter, the role of corrective\actions in the quality control 
(QC) cycle is discussed. Subsequent chapters present analyses of corrective action, 
alternatives and recommendations f<Sr both item-specific and general delivery system 
management actions. ' 



1.1 THE ROLE OF CORRECTIVE ACTIONS IN THE CONTEXT OF QUALITY 
CONTROL \ 

- ■ i ' 

Quality control is cyclical in nature as depicted in Figure 1-1. The first steps, 

involving\pecification of the subject for control (Step 1), definition of a measurement 

unit (Step 2), and establishment of a performance standard (Step 3) represent the task 

of defining quality. The next two steps (Steps 4 and' 5) are concerned with the actual 

measurement of quality. In Step 6 actual performance is compared with standards in 

order to identify and document errors. Corrective actions are selected (Step 7) and 

implemented (Step 8) as the final stage of a complete cycle. However, once the cycle 

is completed, maintaining a high level of quality requires repetition of the cycle as 

indicated by Step 9. 
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FIGURE 1-1 «. 
THE QC CYCLE: FEEDBACK LOOP 
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This volume of the Pell Grant stu3y final report was also written in the context 
of the quality control cycle. The results of the earlier steps in the cycle define the 
need for corrective actions.. In Volume 1, Findings, the, r steps of error definition and 
measurement in the Pell Grant program are described. While average error dropped 
between 198b-81 and 1982-83, substantial error remains. This error was isolated to 
several key factors— in quality control terminology, the "vital few 11 — through an 
analysis of the various components of error. This allows for the targeting of 
corrective actions to these key factors while placing less impbrtance on attempts to 
reduce the relatively small effects of the "trivial many". Analysis and 
recommendation of corrective actions for the "vital few" are contained in Chapter 3. 

A fundamental decision on the thrust of corrective actions is not explicitly 
revealed by the QC cycle. This decision is whether the nature of the corrective 
actions is to be preventative or remedial. Preventative corrective actions are geared 
toward removing the cause of error and thereby preventing errors from occurring. For 
example, application form simplification is a preventative action intended to reduce 
the number of mistakes a student would commit on a Pell Grant application. Remedial 
corrective actions are 'intended to catch and correct errors that have occurred. 
Current validation proceddres, where applicant data are verified after the initial 
eligibility determination is made, are an example of a remedial corrective action. In 
subsequent chapters we discuss recommended corrective actions in the Pell Grant 
program in the context of their preventative or remedial nature. * 1 

1.2 RECOMMENDED CORRECTIVE ACTIONS 

K 

In the 1980-81 Pell Grant Quality Control Study, corrective actions to solve 
major error problems were proposed within broad themes. In an attempt to reduce 
student error, ^ seven corrective action recommendations were proposed within three 
broad themes: 



• Asking the applicant throve need 

• Improving the identification and validation of likely erroneous applications 
Making the application form itself less error, prone. ^ 



n 
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With the 1982-83 project we see improvements in the quality of certain 
application data items (most markedly parental and independent student adjusted gross 
income and Federal taxes paid) as a result of actions implemented subsequent to 1981. 
This is discussed more fully in Chapter 2. Substantial error still remains however and 
we base our current corrective action recommendations on continued adherence to the 
latter two themes, rephrased to be: - 

• Targeting of validation 

• Clarifying application instructions and data items. '< 

• More specifically, in Chapter 3 we develop and recommend the following 
corrective actions: 

• Expanded validation of first-time independent applicants and tightened 
procedures and documentation requirements for thfcse applicants 

• ^ Itemization of nontaxable income and selection for validation of those 

cases where other income sources are suggested * 

• ' The listing of the names of family members being included in household 

size 

• The listing of the names of household members in postsecondary education 
and clarification of instructions on whorri should be included 

• /Continued AGI validation but at a lower rate 

• The validation of dependent student income where projected income drops 
to half of base year income. ' 

Similarly in 1980-81 we recommended six corrective actions aimed at institu- 
tional error within three broad themes: ' V v 



Creating an incentive for students to complete course work 

Adding new verification requirements for critical Pell application items 

Changing administrative procedures to promote program compliance and 
reduce delay. 



We shift the themes slightly for 1982-83 as a result of the government's* 
movement towards less regulation and greater institutional discretion by: 



• Combining the first two themes into one calling for making the institutions 
the focus of quality control 4 

- «> 

• Rephrasing the second to call for simplification of procedures and policies 
to promote compliance. 

" : *■ '* 

, Specif ically we recommend in Chapter 3: 

• 4 - The consideration of specific cut-off dates for updating cost-of-attendance 

. and enrollment status 

> 

• The adoption of a more structured cost-of-attendance formula 

• The inclusion of an individualized payment schedule on each eligible SAR 

• The simplification or exclusion of Financial Aid Transcript requirements. 

In Chapter we broaden our recommendations from being item specific to more 
general in nature. These recommendations relate to the application process, the 
corrections process, and the institutional process. Following the same broad student 
' S and institution, themes mentioned above, we recommend: 

, ' t 

• , Improved application data collection through a "split form" and augmented 
' ; instructions ' ' 

;. • 4 A changed definition of dependency status to improve the ability to 
document and verify 

m An evaluation of eliminating data items from Pell Grant need analysis 
- baspd on the .items 1 reliability, sensitivity, and ease of validation 

f ' • . The establishment of a cut-off date for student-initiated corrections 

• - * ... ' C 

m > The development of regulations, incentives, and technical assistance to 
promote the institutions 1 willingness and ability to perform quality control. 



CHAPTER 2 

EFFECTIVENESS OF PRIOR CORRECTIVE ACTIONS 

2.1 PREVIOUS EFFORTS , 

, In # l 978-79, the Department of Education (ED) funded a pilot study o^quality in 
the Pell Grant program. A sample of 2,000 students attending 200 institutions was 
used to test the feasibility of various data collection and analysis techniques related to 
quality control for a student aid program. The pilot study also prbduced preliminary 
error findings and a list of recommendations for corrective actions. 

The result of that study was an increased realization of potential problems in the 
application and award process for the program and of the need for management 
improvements. Subsequent actions included: 

• Improved computerized edits to check \hconsistencies in the student's 
• application for aid 

* • Field-tests of Pell Grant application form prototypes by an independent 
contractor to lessen difficulties in filling out the application for aid 
• ■ 

• Introduction of institutional validation of selected application items on a 
sample of eligible students chosen by pre-established criteria thought to be 
related to student error 

• The procurement of contracted services to conduct a full-fledged Pell 
Grant quality control project. 

The next Pell Grant Quality Gontrol Project was initiated in September 1980. 
The purpose of the first stage was to continue the QC cycle for 1980-81. This involved 
the re-measurement of error using a larger, statistically representative sample of 
^,500 students at 300 postsecondary institutions. Additionally, the error definitions 
were refined, the data collection and analysis methodologies were improved, and the 
findings were tied to specific short-term and long-term corrective actions. This 
report is for the next QC cycle, 1982-83. 




In this chapter we review corrective actions taken by the Education Department 
-since the 1980-81 processing year-and, where possible, examine their effectiveness. 
We have identified seven corrective actions aimed at improving various parts of the 
Pell Grant award process. They vary in scope from a large-scale validation effort to 
the simple rewording of- edit and error messages sent to the applicants. 

^ THE APPARENT EFFECTIVENESS OF PREVIOUS CORRECTIVE ACTIONS 

Between the time of the 1980-81 Quality Control Project and the data collection 
of this Stage Three (1982-83), the Education Department initiated five corrective 
actions aimed at improving quality. These were: 

A substantial increase in 1982-83 in the number of students selected for 
validation, focusing on application items verifiable by IRS tax forms 

The elimination of a separate Statement of Educational Purpose (SEP)— 
instead,incorporating the SEP into the Student Aid Report 

The intrqduction of Error-Prone Model (EPM) criteria for validation 
selection 

The establishment of requirements for an independent quality control unit 
at the application processor W 

The simplification of edit and error messages reported to applicants. 

Although it is not possible to assess the impact of each corrective action 
independently of the others, we can get rough indications of the effectiveness of these 
attempts to improve quality. The evaluation of corrective actions by explicit 
measurement is an important step in the QC cycle. The measures of effectiveness 
relate to changes in the quality measures themselves— the increase or decrease in 
error associated with the components targeted by the specific corrective actions. In 
this section, we review those error changes as measured between 1980-81 and 1982-83. 

It should be first nofed that ED continues to introduce actions to improve Pell 
Grant program quality. Subsequent to our 1982-83 data collection, three corrective 
action procedures were introduced: 

\ 

• Simplification of the Pell Grant Payment Schedule 



• Cross-year editing of selected application items 

• Required in-year updating of enrollment status and cost-of-attendance— 
"rolling" corrections. 

* -» 

These actions are briefly discussed at the end of this chapter. 

2.2.1 Aggregate Results 

As reported in Quality in the Pell Grant Delivery System; Volume 1, Findings, 
the upward trend in error noted in 1980-81, as compared to 1978-79, has been turned 
around. Specifically, absolute error per recipient dropped from $288 per recipient in 
1980-81 to $239 per recipient in 1982-83. Similarly, net error per recipient dropped by 
24 percent / net student error per recipient dropped 9 percent , and net institutional 
error per recipient dropped 49 percent . In 1980-81, 71 pqrcent of all Pell Grant 
recipients had award errors in excess of $2. In 198?-83, this figure dropped to 62 
percent. Despite som^ methodological limitations in making direct comparisons, it is 
clear that, in aggregate, the corrective actions that were introduced were successful 
in reducing error in the Pell Grant program. 

2.2.2 1982-83 PROCESSING YEAR VALIDATION 

In 1982, the Education Department initiated a large-scale validation process 
aimed at verifying the income and Federal' taxes reported by all eligible Pell Grant 
applicants. T^e process was to be permanent, but after five or six months it was 
terminated because of objections from financial aid administrators who, could not 
handle the large volume of cases and due to processing delays caused by the larger- 
than-normal volume of resubmissions. It was intended to replace the process used 
since 1980-81 which selected about 7 or 8 percent of the eligible applicants for 
validation using random selection and selection based on some pre-established criteria, 
and which required the financial aid adminfstrator to verify seven items on the 
student's eligibility report. Under the new process, the aid administrator was only 
required to verify -adjusted gross income (AGI) and Federal income^ tax (FIT) as 
reported on the parents 1 or independent students 1 1040 tax forms. It was felt that 
restricting the validation to easily verified items would serve the double purpose of 
reducing the error in those items and easing the time spent on validation peh recipient. 
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There were two other reasons for moving to large-scale validation. First, it was not 
possible at that time to identify the error prone cases, thus targeting or more focused 
selection could not be implemented. Second, OSFA was concerned with the problem 
that students only needed to appear needy rather than prove need. Validation through 

supporting documentation is a method of proving need. 

■;'[.'■ ^ ' / . * * ~ 

*r' • I .? ■ '/' * r , 

The process proved to be quite effective in that the residual error rates for 

1982-8^ were significantly lower than found in 1980-81. For 1982-83^n estimated 

102,000 recipients, ^percent, were found/^o have error in AGI and FIT remaining after 

their last submission. For>^rents ax\^ independent students the AGI error had award 

consequences which amounted tfr$6.7Q for each aid recipient in 1982-83. This^was a 

decrease of 58 percent from the 1980-81 AGI award error of $16.10 per recipient. 

Program- wide absolute error for AGI amounted to $37 million (net error was $16 

million). 

•f 

When students are notified on their Student Aid Report (SAR) that they have 
been selected for validation, they have the opportunity to correct information on their 
application by resubmitting their SAR. Table 2-1 indicates two shifts in corrections 
behavior. First, total resubmissions have declined possibly as a result of the students 
being deterred by the threat of validation. Second, the corrections rate for reported 
income and taxes paid increased from 1980-81 possibly reflecting the effect of 
validation on these two items. Since validation measured the error between the value 
of the relevant item that the student should have reported— the "best" value— and the 
value of the item that was usecffit is not possible to isolate this notification effect. 

It also appears that 'focusing validation on just these two items allowed a 
significant amount of additional error to' creep into two other items— other nontaxable 
income and the number in postsecondary education. Program-wide absolute error rose 
from $9.30 to $19.20 per recipient for the nontaxable income item and from $5.90 to 
$9.60 per recipient for the number in postsecondary education item, between 1980-81 
and 1982-83, respectively. 

2.2.3 ELIMINATION OF SEPARATE STATEMENT OF EDUCATIONAL PURPOSE 

A separate Statement of Educational Purpose (SEP) was required to be on file 
with each student's Student Aid Report (SAR) until the 1982-83 processing year. But 

ERIC . 7> 



* \ - ■ 

TABLE 2-1 

RECIPIENTS, RESUBMISSIONS, AND VALIDATIONS: 
1980-81 AND 1982-83 



Percent of . 

v Resubmissions 
^ * , jvith Changes 

in Adjusted Gross Number of. 

Processing Number of Number of Number of Income and Federal Validated 

Year Applicants Resubmissions! Eligible Applicants Income Tax2 Recipients 

1980-81 5,100,000 2,169,000 ' 3,367,000 ■ 4 40.096 ■ 251,000 

1982-83 5,119,000 1,830,000 3,327,000 W.7% 1,281,000 



ro 



*From program recof-ds of history corrections, resubmissions equal total transactions less original transactions. 

2 

From Pell Grant Quality ControlStudy resubmissions for recipients only. 

( • ' , , 
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since 19£8-79, it has been observed "that for about 4 percent of all recipients, the 
institutions did not have a SEP on file. To reduce, in fact, to almost eliminate, this 
error it was decided to merge the educational purpose statement onto the SAR and 
have, the student sign the institutional copy of the SAR. ^ 

As a result of this action, the incidence of error fell-^o below one-half of 
1 percent in 1982-83 and the net error for each recipient fell from about $36 in 1980- 
81 to $5.40 in 1982-83. Net program-wide error fell to $10 million. 

2.2.4 ERROR-PRONE MODEL FOR VALIDATION SELECTION CRITERIA 

f In 1983-84, the Education Department implemented a system to improve the 
accuracy of the validation process that used a model to identify those cases with the 
highest net payment error and flag those cases for validation. This was ah attempt to 
sharpen the validation process by pinpointing the most significant errors. 

The 1983-84 error prone model, which was sequenced after the existing selection 
criteria, was developed using a sample of recipients and the 1980-81 Quality Cpntrol 
Study data base. 

For 1984-85, the Department is using an EPM which was developed, augmented, 
and refined using three different data sources, , and it is expected to perform more 
effectively than the 1983-84 model. \ 

2.2.5 INDEPENDENT PROCESSOR QUALITY CONTROL UNIT 

Beginning, with the 1984 processing year, it is a requirement that the Pell Grant 
processor maintain an independent quality control unit. Following on earlier recom- 
mendations from Advanced Technology and others, the Department decided that this 
unit would keep some operational problems at the processor to a minimum, including 
the physical handling of the applications, other paperwork, and the integrity of the 
applicant data. 

The types of specific errors that this unit would be expected to resolve are: 



• Accuracy of telephone ip^uiry responses „ 

• Receipt control problems, e.g., incorrect batch size ajid document counts 

• Coding errors for both application data and current status. 

" ' ■ 

The effectiveness of this action has not yet been measured (see -report "A Framework 
• K for a Quality Control System for [Vendor/Processor Contracts," Advanced Technology 
for the Department of EducatibiSii fSeptember 1982). ■ 



2.2.6 SIMPLIFICATION OF EDIT AND ERROR MESSAGES 



It was found that applicants were having difficulty rmerpreting^pme of the over 
300 messages that can appear^nr the SAR« In some cases, it was alscTTound that 
messages were in fact contradictory. 

■ ' w k- ' 

For the* 1983-8** processing year, it was decided to reword some of these 
messages to try and reduce .;ja$$f| misunderstanding. It is too early to measure the 
effectiveness of this action. ■ '%Sr 



2.2.7 SIMPLIFICATION OF PAYMENT SCHEDULE 



In an attempt to reduce ^ook-up M error, the Education Department revised the 

Pell Grant payment schedule 4$ broadening the Student Aid Index (SAI) ahfci Cost of 

Attendance (COA) ranges. jqsiiead of $50 intervals, they were expanded to $100 

.' ' * r.'i . 
intervals, thus cutting in hdlf/tjfc number of payment cells and, consequently, reducing 

the chances of locating or "loo^ing-up" the wrong cell. At the same time, however, 

these expanded intervals willlr^sult in awards that are somewhat less sensitive to SAI 

and cost of attendance difference. 

' \£#;< 

This modification should also serve to reduce the number of recalculations that 
will be required when an applifcant resubmits his form because it will take a larger 
change in SAI or COA before *|he award is affected. Having just begun in 198^, if% 
too early to measure the effectiveness of this action.' 



2.2.9 CROSS-YEAR EDITS 

t 



For the 1983-8*f processing year, the Department initiated a set of "cross-year" 
edits which compare selected application items with comparable items reported in the 
previous year. Significant deviation from prior year values generates follow-up 
messages oo the SAR and/or validation selection. There has fieen no opportunity to 
measure the effectiveness of this preventative action upon student error. - 

2.2.9 "ROLLING" CORRECTIONS 

With the 198^-85 processing year, the Education Department initiated a new 
system which allows better tracking of a student's enrollment status and cost of 
attendance. Aid officers will now be required to update these two items when they 
learn of changes. This is a change from the previous system which delayed the 
reporting of enrollment status or cost changes until the end of the school year. This 
new system, which permits "rolling 1 * corrections, will reduce the burden that some aid 
offices felt under the former end-of-year validation rosterjjrocess. 

> 3ft » 

Since the "rolling" corrections system has not yet been implemented, there is no 
evidence upon which to judge its effectiveness as a solution to enrollment status and 
cost of 'attendance errors. 
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CHAPTER 3 

RECOMMENDATIONS FOR REDUCING APPLICATION 

AND INSTITUTIONAL ERRORS ' 

In spite of the corrective actions already in place (as reviewed in Chapter 2), 
there is a body of errors that is either not addressed by those actions or appear to be 
somewhat impervious to reduction under current practices. In this chapter, corrective 
actions are presented and discussed which address 10 such errors. Our selection was 
based on the severity of the error, in terms*of program-wide error (see Table 3-1), and 
the feasibility of potential alternative corrective actions. 
<. .# 

In this chapter we will examine each error, its likely causes, its impact, possible 
means of error reduction, and our recommendations as to what' action should be takerr. 
A separate section is .devoted to a discussion of each specific error. This is followed 
by a discussion of the implications of these recommendations on costs, benefits, and 
/ administrative requirements. Finally, we provide a summary chart of the problems, 
estimated error amounts and rates, and proposedorecommendations. 

In addressing the six application error areas, two themes were followed: 

• Targeting validation toward the types of students (e.g., first-time 
independent students under 20 years of age) or types of error (e.g., income) 
that would have the highest payoff. This targeting will result in a 
reduction of burden fof parents, students, and institutions. As discussed in 
Section 1.1, this is a form of remedial corrective actions. 

{. 

• Improving the application form by either clarifying definitions (e.g., 
nontaxable income) or requesting clarifying information (e.g., names of 
household members). This is a form of preventative corrective actions. 

a • 

In addressing the four areas of high institutional error, two other themes were 
followed: 

L 

• c Simplifying procedures and policies, for example, of enrollment status 
regulations and the payment schedule 

• Putting more emphasis on the institution as the focus of quality control. 

3-1 
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APPLICATION ERROR 

3 . 1 Improper Identification of 
Dependency Status 

3.2 Incorrect Reporting of 
Other Nontaxable Income 

3.3 Incorrect Reporting of 
Household Size 

3 A Incorrect Reporting of 
Number in Postsecondary 
Education 

i 

3.5 Incorrect Reporting of 
Adjusted Gross Income by 
Parents and Independent 
Students 

3 . 6 Incorrect Reporting of 
Income by Dependent Stu- 
dents 

INSTITUTIONAL ERROR 

3.7 Incorrect Determination 
of Enrollment ^Sta^tus^^v^ 

3 . 8 Incorrect Determination 
of Cost of Attendance 

3.9, Incorrect Award Calculation 
or Disbursement 

3. 10 No Financial Aid Transcript 
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TABLE 3-1 

ESTIMATES FOR THE TErf SELECTED APPLICATION 
AND INSTITUTIONAL ERRORS 

Estimated Error ($ Million) 



. Overaward 

$ 64 
$ 46 
$ 44 

$ 32 

$ 26 
$ 13 

$ 54 

$ 14 

$ 40 
$ 95 

'./■■ 



Underaward 

$ t/ 

$ o 

$ 10. 
$ 9 

$ 11 

$ 1, 

$ 94 

$ 35 

$ 16 
$ 0 



Net_^ Absolute 



- $ 64 
$ 46 
S $ 34 

$. 24 

$ 16 
$ 12 

$-39 
$ -21 

$ 21 
$ 95 



$ 64 
$ 46 
$ 54 

$ 41 

$ 37 
$ 14 

$148^ 
$ 49 

$ 56, 
$ 95 



Recipients Affected ^ 
Number Percent 



139,000, 



256,000 
149,000 

102,000 
37,000 

564,000 
273,000 

311,000 
81,300 



5.5 



254,000 . 10.0 



10.1 



5.9 



4.0 
1.5 

22.3 

10.8 

12.3 
3.2 
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3.1 RECOMMENDATIONS F(*R REDUCING APPLICATION ERRORS 

f . . ■ . . . • 

3.1.1 IMPROPER IDENTIFICATION OF DEPENDENCY STATUS 

The task ofjtsuly differentiating between dependent and independent students is 
inherently imperfect. The three-part definition that is currently in use does not solve 
that problem, but it does define the boundaries within which applicants can err. In 
1982-83, an estimated five and a half percent, or 139,000, of all eligible applicants 
were reclassified, resulting in net overpayments of $6* mUlioi^^ In 
Chapter *f we 'will take up the issue of how the current definition^ 
this section we will deal with minimizing or reducing error under the car definition 
through reliance upon validation selection criteria and documentation ^ 

Selection Criteria 

How do we decide who should be selected for dependency status verification? 
From our study we learned that of those who were improperly identified 93 percent 
initially classified themselves as independent. Since this is the large majority of 
erroneous cases, we could decide to pull out for verification all those who reported 
themselves as independent. For 1982-83 this would have amounted to over one million 
cases and would probably impose unreasonable burden oil applicants and institutions. 
This universal approach would also likely increase the number of corrections submitted 
to the processor. Since we found that only 12 percent of all independent applicants 
were misclassified, this universal approach appears unnecessary and it suggests that 
we should narrow our selection criteria to those who are most likely to be 
misclassified. 

One approach to focusing the selection criteria is to verify the reported 
dependency status of only thos^ applicants claiming independent status for the first 
time. This group would include any applicants who switched from dependent to t 
independent while in school. Under this approach perhaps up to 500,000 applicants** 



♦Underpayments were less than $500,000. 



**The QC project data base does not have a cross-year comparative capability. Thus, 
the number or percent of applicants who are claiming independent status for the first 
time ciinnot be determined from these data. 
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TABLE 3-2 



DEPENDENCY STATUS ERROR: 
1982-83 9, 



Recipients Verified 
To Be 



Independent 



Dependent 



\ All 
Recipients 



Independent 



35.9% 
(908,000) 



; 5.1% 

(129,000) 



41.0% 
(1,037,000) 



Recipients 
Reported 
To Be : 



Dependent 



0#% 

(io,ooo) 



58.6%> 
(1,483,000) 



59.0% 
(1,493,000) 



All Recipients 



J 



«36.3% 
(918,000) 



> 63.7% 
(1,612,000) ' 



100.0% 
(2,530,000) 



✓ 
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would be selected for verification. The main rationale for this targeted approach, 
other 'than a reduction in the number of cases requiring verification, is that it would 
probably cut down any subsequent intentional erroneous switching because students 
would need to verify dependency status changes. 

This level of verification is still quite higtr compared to, for example, the total 
of 250,000 recipients in 1980-81 who were validated not only on dependency status but 
on Six other items gs well. In an effort to further reduce this number we studied the 
likelihood that w^xaauW-differentiate erroneous from nonerroneous cases on the basis 
of other inforn^ation available to us on the application. Three applicant characteri- 
stics were tested to see how well they would predict dependency status error— age; 
marital status, and household size; The results are displayed in Table 3-3* and show a 
clear correlation among each of these three characteristics and incorrect filing as an 
independent student. By focusing validation of dependency status on the highly error- 
prone groups— young, unmarried, applicants from small households who file as 
independent students— an^f f icient remedial corrective action can be affected. 

Implementing this proposal would simply require^She r.anking of the 18 groups 
formed by combining the 2-marital status, 3-age, and household size categories. 
Cases falling into the group with the highest dependency status error would be 
selected for dependency status validation. Cases falling into the group with the next 
higest error rate would then be selected. Additional groups would be selected until the 
error rate of the next highest group falls low enough that validation of cases falling 
into that group is no longer justified. 

Documentation Requirements 

Once applicants have been selected for verification of this item, how can the aid 
administrator best determine if they are in error? In 1982-8*3 the documentation 
requirements for dependency status appeared fairly lax: 

•*& 

"If the applicant is dependent, a statement signed b f & a parent 
and the applicant attesting to the three dependency cpsstions is 
sufficient documentation. If the applicant is independent the 
applicant^ signature is sufficient documentation."** . J$t* 



*For a more* detailed discussiori see "A Specific Proposal for Increased Validation of 
Independent,Students," Advanced Technology* November 1983. 

**FrorTvPell Grant 19*2-83 Validation Handbook. ' ', . . " y \ 
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TABLE 3-3 



DEPENDENCY STATUS ERROR BY 
APPLICANT CHARACTERISTICS 



MARITAL STATUS 

Married/Separated 
Unmarried 



Percentage of Applicants Who Filed 
As Independent but Were Found to be Dependent 



9.7 



AGE 

19 and under 

20 through 25 
. 26 and over 



20.2% 
10.5 
2.7 



HOUSEHOLD SIZE 
1 

2 

3 or more 



8.9% 

7.5 

3.8 
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Those requirements provide the aid administrator no way of verifying the 
accuracy of reportedly independent applicants who comprise the overwhelming 
majority of erroneous cases. Further, there is no attempt to document each of the 
three dependency criteria for either dependent or independent applicants. 

One form of documentation aimed at reportedly independent applicants would be 
to review the tax forms of their parents. Although exceptions would have to be made 
for certain cases, this would be the most straightforward means of identifying an error 
in both the exemption and support criteria. There appear to be some legal obstacles to 
this method for first-time independent filers since parents do not sign/certify the 
application. However, it holds promise for those who switch from dependent in the 
prior year to independent in the current year since verification would be for the prior 
year application which would have been signed by the parent(s). 

. 

Other forms of documentation such as rent receipts or mortgage payment stubs 
could serve as a check on residency criteria for independent applicants. The data show 
^ that over *3 percent of the erroneous independent applicants were identified solely by 
checking their response' to residency criteria. It appears that if access to parents' \ax 
forms is not possible, then the focus of the validation process should be on the 
accuracy of the residency criteria response. 

Also in the absence of the parents' tax returns, a signed affidavit of non-support 
from the parents would appear to be the next best documentation. This is at least 
likely to reduce the number of unintentional incorrect responses to the support 
criteria. Moreover, in the case of families who do not file Federal tax returns, this 
affidavit will probably have to suffice. 

Recommendation 3.1: We recommend expanded validation of first-time 

independent applicants and tightened procedures 
and documentation requirements for these 
applicants. 

3.1.2 Incorrect Reporting of Other Nontaxable Income 

Item 27c on the Application for Federal Student Aid requests a dollar value for 
"all other nontaxable income and benefits (child support, disability income, etc.). (Use 
worksheet on page 12.)" The worksheet lists 1^ items that are to be included in this 



category. The applicant is to total the income from the applicable sources and enter 
that for item 27c. From our study of 1982-S3 recipients, we found that 1 (percent of 
all recipients ~ 254,000 — misreported this item and that all the misreporting was in 
the direction of understating the "true" value. The award consequences of this 
understatement amounted to almost $200 per recipient with error or about $46 million 
in net program-wide overawards. 

The complexity of the application and instructions is probably the largest 
contributing factor to this error. Anyone completing the form without close attention 
to the instructions could easily miss one or more sources of income. Closely related is 
the difficulty of determining the values to be included. Since many of the components 
are nontaxable, they are not reported to the recipient on a W-2 or other form.. As a 
result, there is a good deal of reliance upon the recipient's ability or willingness to 
recall these sources. 

There are several alternative approaches to reduce this specific error, short of 
eliminating the item itself: 

• Itemize on the application, rather than on the worksheet, the most 
significant sources of nontaxable income such as tax-free interest and 
unemployment compensation 

• Limit the sources of nontaxable income which must be reported to the 
most significant and most easily documentable such as child support, 
welfare benefits, unemployment compensation, or tax-free interest 

• If selected for validation, require official documentation of all such income 

• Select for validation any applicant who reports any positive amount of 
other nontaxable income. 

_'\ 

If the primary cause of this error is an unintentional omission of some form?' of 
income that are supposed to be reported, the error could be reduced by providing more 
itemization on the application. This would reduce the potential for the applicant 
becoming lost in the instructions or overlooking a source of income if the instructions 
are ignored. This [approach was used recently when Aid to Families with Dependent 
Children (AFDC) wks listed as a separate application item to provide it more visibility. 
AFDC error is now a relatively insignificant source of program-wide error. 
(Unfortunately, previous studies did not determine the contribution that AFDC made 
to other nontaxable income before it was split out as a separate item, so we cannot 



) * 

determine if the action was effective in reducing error.) Other studies have 
demonstrated that the more complete the definition that is placed on the form, and 
the less dependence placed upon separate instructions, the more easily and accurately 
the item can be completed. 

Limiting the required sources would remove some of the less common and less 
substantive sources of other income and benefits which are difficult to document or 
perhaps have little affect on eligibility. It would^ssume, for example, ^hat retirement 
and pension benefits would-be going to persons with limited income, or that significant 
amounts of welfare or unemployment compensation or disability payments were going 
to families with zero eligibility indices and should not decrease Pell eligibility*. The 
advantage of this approach, of course, is simplification of instructions, validation, and 
documentation. The primary disadvantage is the increased eligibility it would provide 
to those cases where this other income did make a difference. 

Requiring additional validation documentation for those selected can be 
burdensome for several reasons: 

• Official documentation from some of these sources is difficult to obtain. 
For example, the study interviews with institutional personnel pointed out 
the problem of getting documentation from some agencies, particularly the 
VA and welfare agencies 

• It is often difficult to interpret the documentation that is available, for 
example, determining the various allocations of multiple benefits to 
appropriate parties 

• Even when some documentation is provided, it is often impossible to 
determine whether or not all sources and amounts have been reported. 
Sources omitted in the original filing are also likely to be absent from the 
validation documentation. » 

Currently, if this item is zero on the initial application, neither the edit process, 
the Validation selection process, nor the institution would check on the possibility of 
other income and benefits unless there were some other indications oMn^onsistfjiQ^^.^^,^^ 
like taxable portions of such income on the tax return. 

Recommendation 3.2: We recommend that the required components of 

nontaxable income be itemized to minimize 
accidental omissions and that the validation 
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selection process be modified to select those 
^ cases where other income sources are suggested 
by family demographics such as age and sex of 
family head. 

We encourage additional training opportunities 
(workshops and written materials) to instruct fi- 
.1 nancial aid personnel on how to read tax returns 
, and similar documentation which can be useful in 

identifying, correct amounts of income from these 
sources. We also urge the Department to explore 
additional data matches with the agencies provi- 
ding these benefits, as a means of automated 
validation on the "front end." 

3.1.3 Incorrect Reporting of Household Size 

* 

In 1982-83, we estimated that a little over 10 percent of Pell Grant recipients — 
about 256,000 — would require payment changes because they incorrectly reported 
their family size. These errors cost the program a net overaward of $3* million. 
While there is no indication in the study data that intentional exaggeration of 
household size is a significant problem, within-year upward corrections to household 
size should be subject to validation as well as monitoring and validating changes across 
years. 

In-home interviews with students and their parents indicated that about one- 
third of the applicants who made errors on this item had difficulty completing the 
application. Beyond this, there is some difficulty projecting family size into the 
upcoming school year because the application can be filled out before the school year 
begins and becaus^j of rapidly changing family plans and circumstances. 

There appear to be only a limited number of alternatives available to reduce this 
error. Most promising among them are: 

• Change the application to require the listing of household members by 
name, age, and relationship 

• Reinstate household size as a required validation item whenever it does not 
agree with the reported number of tax exemptions, then collect the 
itemized listing as a part of validation 

• Use IRS tax exemptions in lieu of household size in the determination of 
the appropriate family size offset. 
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Revise the Application to Require the Listing of Members of the Household 

r 

This approach is consistent with that used by the IRS to determine the number of 
exemptions. The College Scholarship Service (CSS) form supplement also uses this 
technique to help establish the household size provided on the "core" document. One 
constraint to implementation of this option, in^addition to concern about respondent 
bjjrden, is the practical one of insufficient space bn the present 2-page application. 
This problem could, however, be overcome with adoption of the "split form" 
application (see Section 4.1). This approach would at least have the benefit of 
providing the validator a better basis for identifying discrepancies. 

Use Discrepancy Between Household Size and Tax Exemptions as a Validation 
Selection Criterion 

This alternative would force reconciliation of any differences between these two 
similar elements as a part of the validation process. It has a number of problems, 
however: 



The number of exemptions, and thus the comparison, is available only for 
. tax filers, which excludes 13 percent of dependent and 30 percent of 
independent Pell Grant applicants 

• The definition of eligible ex^nptions is not identical to that of household 
size, although there is some correlation 

• The number of exemptions is retrospective, while household size is 
prospective * 

• The ability to provide or secure documentation, one of the advantages of 
the tax exemption measure, is compromised if it is converted to a 
prospective measure 

• Use of this criterion would mean flagging approximately 36 percent of the 
dependent cases and 22 percent of the independent cases for validation, 
perhaps more respondent and institutional burden than the Department 
might desire to impose. 

Use IRS Exemptions Instead of Household Size in the Determination of the Appropriate 
Family Size Offset 

This alternative is particularly appealing in its apparent contribution to simplifi- 
cation of the application. However, it has some of the same shortfalls cited above, 
namely: " 
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• Some other measurg^ould have to be used for non-filers of Federal tax 
returns « : 'f 

• Some sensitivity to changing family circumstances would be lost by the 
„ retrospective nature of the tax exemption 

f. . 

• Some sensitiYity- would also be lost for those households which are 
supporting oth§r l adults, but for one reason or another are not claiming 
them for tax ptirpQses 

• According ta;<iur study data, the tax exemption number would be different 
from household Size in 36 percent of the dependent cases and in 22 percent 

p of the independent cases. These differences do not always cause changes 
in payments Jt^ause of Sther program features. 

The major consideration concerning use of number of exemptions in place of 
prospective household siz§ is one of program intent. The practical consequences of 
shifting are likely to be?, minor redistributions of program funds on the order of less, 
than one percent for riumtftr of recipients and program expenditures. 

Recommendation 3L3: We recommend pursuing improvements in the applica- 

{ ° tion and instructions to increase the accuracy of that 

j * reported value by listing the family members being 

% included in household size. 

We recommend that the Department give consideration 
i to replacing prospective household size with number of 
y .■ \ tax exemptions. 

3.1.* Incorrect Reporting of Number in Postsecondary Edtgation 

The resvUts of ( our study showed that about 6 percent of Pell Grant recipients 
misreported then^ber of household members who would be enrolled in postsecondary 
education. Most of these 1*9,6 00 recipients with error overstated the "true 11 number 
and, as a result, received awards that averaged over $160 more than were appropriate. 
In total, their errors resulted in $32 million in overpayments and $9 million in 
underawards, or-a-net program-wide overpayment of $2* million.* 



*It should be noted that ED's optional validation instructions to institutions require 
letting the reported value stand unless it was evident that such an estimate was 
unreasonable at the time of application. Since reasonableness would be< difficult to 
gauge, it is strongly suspected that veryf ew changes were initiated by validation even 
where it was performed on this item because of noted inconsistencies in other 
documentation or at the institution's discretion.' Our study techniques, on the other 
Jiand, made no such judgements and revised SAI (and award) for each case with 
discrepancy. Thus, the' error rates cited in our study measure a different error than 
would be measured urtder the current validation policies. 



Our study findings suggest that difficulty understanding the application and 
instructions is not a significant problem. In fact, only 16 percent of those applicants 
misreporting this item acknowledged having any problem with Section C — Household 
Information — of the application. Even if respondents are timid about admitting a 
problem, there seems to be a good understanding of what is expected. 

O * v i 

Although not revealed in the data, familiarity with the clarifications resulting 
from validation suggests that one uncertainty about this item is whether or not a 
parent attending school should be counted (a parent should be included as long. as 
he/she is enrolled at least half-time)^ To a lesser extent, independent applicants 
wonder about inclusion of the spouse. In neither case is there much question about 
including dependent children based upon their enrollment status. 

There are three potential corrective actions that could be utilized to address the 
error associated with the misreporting of number in postsecondary education. 

• Amend the application to require applicants to list all persons included in 
the response to this question by name, age, and institution to be attended 

• Require validation of all cases reporting more than one (the applicant) in 
postsecondary education 

• Allow reporting of and adjustment to SAI for, dependent applicants 1 siblings 
only, not for parents. 



Require Applicants to List All Family Members to Be Enrolled in Postsecondary 
Education 

This approach is an.extension of the proposition advanced for household size, and 
could in fact be accomplished by adding a columi$to the household size listing format 
to indicate the school to be attended. This is the same approach used by CSS on its 
supplement to the core application foctPell purposes. The theory, as stated earlier, is 
that having to list rather than just count will increase the accuracy of the reporting. 
For those applicants filing their data with CSS, this listing would be available to the 
institution for verification purposes as well. 



3-13 , 



36 



Require Validation of All Cases Reporting More Than One in College 

Another way to address the possibility of applicants receiving more adjustment 
than they should is to validate each case reporting more than one family member in 
postsecondary education. However, this would require *f00,000 to 500,000 validations^ 
which may be more burden than ED will want to place upon the applicants or the 
institutions for this one error source. Moreover, it would not be a productive effort 
unless the current validation procedures were amended to permit corrections when 
discrepancies are found, regardless of the reasonableness of the estimate at the time 
of application. Intent to deceive is very difficult to determine, and the institution 
should not have to judge whether or not the estimate was reasonable, only whether It 
was accurate. 

Restrict Adjustments for More Than One in CoUeg^tqApplicant Siblings 

As noted earlier, anecdotal data indicate that whether dr not parents attending 
postsecondary education are to be included in the estimate for number in postse- 
condary education is a source of confusion, if not error, in this item. Additionally, 
many financial aid administrators are concerned about the inclusion of the parent(s), 
as they tend to be only part-time, live at home, and otherwise do not place the same 
financial burden on the family budget as other dependents. Perhaps a direct allowance 
for unreimbursed tuition and fees would be a more appropriate- treatment for the 
expenses associated with parental attendance, rather than including them in the more 
substantial adjustment process presently practiced. In any event, eliminating parents 
of dependent applicants would reduce applicant confusion about proper completion of 
the question. Alternatively, if parents are to be included, it would be useful to error > 
reduction if parents were specifically mentioned in the instructions., 

Recommendation 3.*: We recommend changing the application to require 

listing the names of all household members) in post- 
secondary education. In addition, the issue of whether 
parents should or should -not be included needs to be 
clearly defined in the application instructions. 
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3.1.5 Incorrect Reporting of Adjusted Gross Income (AGI) by Parents .and Self- 
Supporting Students 



From our study, we found that a significant amount of AGI error was uncovered 
through the extensive validation process that was in effect during 1982-83. The 
amount of error and the number of cases with error that remain are relatively small 
compared to other errors that we found, but the impact of AGI on the award 
computation makes it necessary to continue pursuing farther error reduction. This is 
especially true for independent applicants where the "xax" rate on AGI is high and 
where the likelihood of other incon\e is small. In all, we found 4 percent of all 
recipients — about 100,000 had AGI error, which had program-wide payment conse- 
quences of $16 million in net overpayments. 

It is likely that part of this remaining error may . stem from two logistical 
situations: - 

•-Oh V. 

• The family completes. the application prior to completion of thfir Federal 
% tax forms, or *£V 

• The student completes the application without access to the parent's tax 

1 fornru r v 

Whatever the likely cause, there are four approaches to consider for error 
reduction: 



• Notify applicants not to file for Pell Grant until Federal. tax forms are 
completed > ^ > 

• Require submission of Federal tax forms along with application 

• Require submission of Federal tax forms ^Hen eUgibl^ applicant submits 
SAR to an institution " ; : : ^ - . * : : - * - ' / \ " ; ■ : ^ : 

• Maintain AGI validation, but at reduced levels addressed to a more 
targeted population. 

Study data showed that there was about a $45 lower student error per tax-filing 
applicant for applicants who reported actual rather than estimated income and tax 
data. While the current application instructions encourage completion of the; tax 
return in order to facilitate the completion of the application, the language could be, 
made stronger to indicate that the form SHOULD NOT be , completed f^ti! the tax 
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retlirn is available for reference. If this instruction was followed, it would likely 
reduce the discrepancies between reported AGI and documented AGI. It would also 
reduce the completion of the application by the dependent studenE\without close 
consultation with the parents. On the other hand, it might also have the effect of 
delaying submission of the application and creating processing backlogs later in the 
year. However, a similar requirement in conjunction with, the Vermont State Grant 
Program had the opposite effect and caused the tax retjjrns to be completed and 
submitted earlier. This alternative obviously would need a caveat for those who would 
not be filing FederaJ tax returns, so that they would proceed without delay. 

A possible variation is to request that a copy of the return be attached to the 
application. This procedure would clearly slow down submission of the application 
because of problems getting the return fully completed, and copied. It would "also 
create a problem with the application processor, to receive and maintain the 
additional paper. Keeping tax returns matched with current applications would be 
nearly imppsSible because of the absence of any '.parent name^drvSocial Security 
number on the application forms. Different last names in many i , cases preclude 
matching on that bdfeis. Some provision for non- filers would have to be made, such as 
a statement of non-filing. ; . 



vOn the positive I side, the submission ^f the tax return woqld 'permit the initial 
valuation check to bd mad? by the processor. Where agreement was^npt^d, the tax 
return would not have to be provided to the institution unless there was need to follow 
up on some other discrepancy. This approach would transfer much of the burden of * 
validation of AGI and Taxes Paid from the institution to the processors. It would allow 
institutions to concentrate upon exceptions and to pursue cases with discrepancies 
much more completely In balance, we feel that requiring the tax returrr with the • 
application would be effective, but would be too cumbersome for the processor and 



would represent a signif 



were required with Va! 



cant applicant burden. 



; Only requiring Feceral tax forms when the eligible applicant submits the SAR to 
the school would lessen, the ,del^ in, submitting the application and maintain , : /tfre 
current processing load at the 'pif;6qes$or site. It would also maintain the validation 
burden at the institution^ and would in effect be 100 percent validation if the returns 



SA&s. This approach also creates more burden on both 



applicants anddnsiitutidns. 



The current validation approach has demonstrated its effectiveness as a means 
of reducing AGI error. This effectiveness should not noticeably depreciate with the 
redded levels of' selection from 1982-83, assuming the PEC edits., and EPM selection 
are accurate in identifying the high eVror cases. We believe that the' number of cases 
to be selected for validation should be reviewed each processing year,* Thfe methods of 
selection— PEC^ EPM and, Cross- Year criteria— also should be reviewed each 
processing year hi ordento ^TOtivelyw target validation. ; ^ continuously monitoring, 
reviewing, and revising the selection process, the effectiveness of validation tan be 
continuously improved. . . • . t •.: '; V-'^*;"- 

I ? Recommendation 3.5: We recommend that the application and instruct ' 
r < ; specify that, to the extent possible, the * 

• , V ' < .applicant should complete their Pell Grant appliv : ■ * 

J>;J. >./' cation after completing their or their . parents 1 A 

-j Federal tax forms. 

\ We recommend that validation selection be 

, evaluated, revised,' and monitored as a regular 

processing year event; s ; 

3.1.6 Incorrect Reporting of Dependent Student Inc&rtie 

Our study estimated that in 1982-83 about 3 out /of every 10 recipients 
misreported dependent student income, but* f or orjly 1.5 percent of all recipients did 
this misreporting result in an award change. FoA i hose approximately 37,000 
recipients, their awards wouldthave been lowered by oA $300 and program-wide costs 
would have been $12 million lower. The lack of accuracy on this j$em reflects the 
fact thai* it includes nontaxabl^L income for which no records hav# ifeen kept by the 
student and the error that may^|associated with usirij^ estima^N^^ne during the 
upcoming school year.* 

/- If the item is to be r^^jj^then selected' validation would be appropriate. For; 
example, ED might retire de^ident sibdent income to be validated where, projected 
year income is less tffljp^ percent of base year; income. Validation woukj include 
review of the student^ o^n tax return. 

i> rV^\ ■ < V 

R^ornmendatibri3.6: Valine those applicants whose projected income 
'/ ; dr^fe to less than half of base year income by 

resisting the student's tax form. 




fc . 



it 



♦Current policy permits the use of estimated income -when Ichool'year income is 
expected to be less than 60 percent of b a|J||&r income. 




34, REC0M M^NDATIONS £dR REDUCING INSTITUTIONAL ERROR . , ; - ^ : 




3.2.1 Incorrect ^ Sta 



v ; ! .Oftentimes the financial aid administrator competes a stii|dbrtt r s, Pell Grant 
before the academic year begins, before the student has registered* and before they 
may have talked with the student. As a result, the aid administrator is TioVaware of 
the student's course load plansnand, for purposes of computing the award* must assign 
the student to one of three enrollment categories— full-time, threes-quarter time or 
half-time. From our study we found that in 1982-83 over 560,000 recipients had been 
categorized incorrectly and that two out of three of the recipients had received less 
than they should have. This incorrect determination of enrollment status led to $9^ 
million in underawa«W|r^5^ million in overawards and a net program-wide underaward 
of $39 million. . 

Some of this inaccuracy is clearly the result of non-compliance on the part of 
the institutions in monitoring enrollment status. However, some portion of the 
discrepancy, between actual enrollment status and the status used for determining Pell 
eligibility is, a function of the latitude given ta institutions in determining the 
enrollment status of recipients. In fact, current ^program regulations do not specify 
when the* aid administrator should determine a dTUdfeht's enrollment statu&;, The status 
used at the time the award is initially calculated is sufficient for the first payment 
period. . N f. 

We feel that this error could be ^eliminated by specifying, in regulations, a daiffe 
at v^hich the aid .administrator , must check enrollment statO^ redompute-the award (if 
necessary) and, after which, is not required to monitor any iub.sequent status changes 
for that semestgr. \ 

• , •• , ' J. • ■ » V 

This date-certain for the determination of enrollment status could be set at any 
of several alternative .logical points during the term: 

• Award 'disbursement date. * 

• End of drop/add pefipd 

• End of tuition refjind period (if there is one). 
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The date of disbursement would be the easiest for institutions to implement, but 
would give the greatest potential for mispayment, because of subsequent adjustments 
the student might make. In fact, if time of' disbursement was to be selected as the 
date-certain, we would expect most institutions to be in compliance under current 
practices. It also provides, as our study procedures revealed, some difficulty in 
providing an audit trail, since many institutional, academic and financial record 
systems do not carry all changes to course load by date, but only the most recent date. 

•A ' : 

Confirmation of the changes at the end of the drop/add period poses a similar 
difficulty, since that is an academic definition often not reflected in the financial 
record systems of the institution. Potential for mispayment is less for time of 
disbursement, as there would be fewer changes to course load beyond, the end of the 
drop/add period, but the need for the aid office to make award corrections would be 
more burdensome. 

The end of the refund period may be the best alternative, at* least with respect 
to course loacf changes, inasmuch as any subsequent changes to course load w;ould not 
.put additional money^in the student's pocket. It also is a point in time more easily 
identified ih ,th& institution's financial records. 

*. * . - .V 

Recommendation 3.7: We recommend that the Education Department 

solicit extensive comment from i all interested 
parties as part of ^^nbrmal^rideniaking process 
jXis i on the date-certain a|Jt)roactiLand on the impact of 

various alternative cutoff dates. 

3.2.2 Incorrect Determination of Cost of Attendance ■ ) 

v ' 

A change in a student's course load or in room and board arrangements can alter 
a -student's Pell Grant eligibility. But, just as with enrollment status, aid 
administrators have little guidance on adjusting cost of attendance subsequent to their 
initiaj award determination. Through our study we found that about 275,000 
recipients — 1 in 10— had received an incorrect award because their cost of 
attendance had changed for reasons other than course load changes. And the net 
program-wide error amounted to underawards totalling $21 million. < 

.» 

The present law ancT regulations provide a substantial number of option's to the 
institution. The Pell Grant program originally required institutions to derive actual 

" . " v '.V - 42 ' ■ . ■ 



cost of attendance data for each recipient, including the exact tuition and fee charged 
and the exact institutional room and board bill paid. '.This proved to be particularly 
onerous to institutions which charged tuition by the credit- hour and/or had a number of 
different room and fcoard rates. The law was changed by the Education Amendments 
. of t0 Permit the use of Average rather than actual charges. But the regulations 
still provide the opportunity for an institution to use a considerable number of 
Average Vbudgets^ While such flexibility may be desirable 

from the standpoint of sensitivity to the recipient's actual costs', it does provide for a 
margin of error when the recipient is incorrectly placed in an average cost category. 
We feel that the use of a more structured fofmula approach to cost of attendance 
would reduce the opportunity for error. 

One example of a more structured approach would require reducing options 
available to institutions for vatryiijg the Pell Grant budgets of recipients. Five optidhs 
might be of fered: « » 



i -ft 



A single tuition and fee allowance for each independent institution, based 
upon the standard charge for full-time undergraduate study, would be 
mandated. If charges are assessed by the credit or clock hour, the course 
load incurred by the largest number of full-time students enrolled in the 
previous academic year would be used to determine the "standard" charge. 

• A dual tuition and fee allowance for public institutions, one for in-state 
residents and one for out-of-state students, would be required. Tuition and 
fees for each group would be based upon a standard charge as described 
above. : - 

• A single room arid board allowance for residential students (anyone not 
living with parents, regardless of whether room and board are contracted 
with the institution) would be instituted. It would be'.determined from the 

± iyer^ge cost of institutionally-provided room and board, adjusted to 21 
. meals per week. (If the institution does not provide either room or board 

from which to derive an average, the average prevailing rate for housing 

and/or meals in the local community would be used.) 

• The Rational standard maintenance allowance for students living with 
parents would be continued. 

• The national standard allowance for books, supplies, and miscellaneous 
expenses would be continued, ideally at a more realistic level. 

This more structured formula approach to cost of attendance would likely reduce 
the opportunity to place students into incorrect budget categories. It would also 
elimii/ate the need to adjust the budget for changes in course load that do not involve 
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^enrollmeiVfc status change or for shifts in residence or board arrangements that do not 
involve living with parents. Thus, there would be greater accuracy in cost of 
attendance determination and greater consistency of treatment both within and among 
institutions. 

The primary disadvantage is some loss of sensitivity to legitimate differences in 
cost not adequately reflected in the averaging process. We considered a weighted 
average approach but decided against it because of the additional complexity, 
potential for error, and difficulty in verifying the allowances resulting from such a 
process. Some of this loss of sensitivity is offset by the provision of the on-campu§, 
room and board allowance to off-campus students, rather than ^gstricting that ; 
category to the current standard $1,100 allowance. Additional sensitivity could be 
provided through a more realistic allowance for books, supplies, and miscellaneous 
expenses, since the current $*00 are a significant understatement of current expenses 
encountered by most students. 

Just as with enrollment status there is a question of when cost of attendance # 
changes should be made and when they should be verified. We feel that a cutoff date 
should be set by each school at which time cost of attendance is checked, changes 
made, and no, further changes be made during that term. , 

Recommendation 3.8: We recommend instituting a more structured cost 

of attendance formula which realistically reflects 
average student circumstances at different types 
of schools. 

Regardless of the formula used, we recommend 
> that comment be solicited from all interested 

parties on the establishment of a cutoff date for 
cost of attendance set by each school (see 3.7). 

( 

3.2.3 Incorrfect Award Calculation and Disbursement 

Both the 1980-81 and 1982-83 Pell Grant Quality Control studies have revealed a 
significant amount of institutional error in the conversion of cost of attendance, 
enrollment status, and SAI intp an expected disbursement using the official payment 
schedule. The payment schedule that was used had a great number of small cells that 
were very easily misread. We recommended at the conclusion of the 1980-81 study 
that the payment schedule be simplified by increasing the ranges of cost, SAI, or both, 



ERLC 
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feeling that the small award increments were unnecessarily precise. Such a revision 
has been made for 198*f-85 and should be helpful in reducing that type of error. This 
appears to be the primary reason for award miscalculations which, along with some 
minor disbursement errors, amounted to $2* million in net program overa wards to over 
300,000 recipients in 1982-83. 

A related problem has been the need to issue revised payment schedules after 
their initial release. This increased the payment error because aid administrators 
would unintentionally refer to the old schedule after the new one was issued or would 
not redo those SARs previously processed. While the new schedules will reduce the 
"look-up" error, they will not help to ensure that the most current schedule is used. 

k -^j In order to address both of these problems, we recommend that the current SAR 
format be revised to include an individualized payment schedule for each official SAI 
calculated. This would eliminate the need to refer to a separate payment schedule to 
determine the size of the award. In addition to the SAI, the SAR would show an 
excerpt from the full schedule for that SAI (see Table 3-<* for a suggested prototype). 

Using this new individualized SAR, the institutional staff determining awards 
would need only determine the student's enrollment status and the cost of attendance 
range to determine the proper scheduled award. The Department could develop a 
k more condensed payment schedule (in terms of cost of attendance) and a revised SAR 
format which could accommodate the printing of the appropriate extract from the 
overall schedule. (The Pell Grant processor could, of course, modify the SAR print 
program to l<y>k up the appropriate section of the schedule for the computed SAI and 
insert that section onto the SAR.) 

We would expect to eliminate most "look-up" error* with this approach while 
assuring tha4> the aid administrator is referring to the most current payment schedule. 
Relying only upon administrative action the Education Department could have the 
system developed which could generate and print the new SARs. 

Recommendation 3.9: We recommend that an individualized payment schedule 

be included on a revised format for each official SAL 
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TABLE 3-* 

PROTOTYPE INDIVIDUALIZED PAYMENT SCHEDULE 

Your scheduled award amount will be determined by the official t 
cost of attendance and your actual enrollment status according 
to the following table for a Student Aid Index of 800. 



ENROLLMENT STATUS 



Cost of Attendance 


Full-Time 


3/*-Time 


1/2-Time 


Up to $ 


899 


0 


' * 0 


0 


$ 900 - 


1,199 


300 


* 225 


15 


$ 1,200 - s 


1,499 


600 


450 


300 


$1,500 - 


1,799 


825 


620 




$ 1,800 - 


2,099 


975 


Ik ■ 




$ 2,100 and above 


1,150. 


y\ ■ 860 


'ft V'--" 570 '. 
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3.2.4 Missihg Financial Aid Transcript 



Up until 1980, it was necessary for the aid administrator to know the number of 



previous Pell Grant awards ever received by a student who had transferred to his 
school and had applied for aid, because the Pell Grant program limited eligiblity to a 
total of four years.* A financial aid transcript (FAT) was to be sent, to the, new school 
from the old as a means of documenting and verifying this eligibility requirement. The 
new schopl was not allowed to make more than one disbursement to the transfer 
student until the FAT was on file. According to program regulations, the school would 
be financially liable for any subsequent disbursements as long as the FAT was missing. 
In 1982-83 $95 million** in awards were made to transfer students whose files did not 
contain a FAT. 

Since 1980, the program has allowed for as many awards as necessary to 
complete a first undergraduate degree. The institution now only needs to establish 
that the transfer student's current year award does not exceed his annual entitlement. 
This means that only the much smaller group of within-year transfers needs to be 
checked. Therefore, it appears that the amount of information and the consequent 
time nedessary to produce the FAT now exceeds the resulting benefits. 

Some further reductions in misawarding could probably be achieved by allowing a 
substitute for the hardcopy FAT in the student's file. This proxy FAT could take the 
form of telephpne confirmation of a student's current-year awards. And as with other 
institutional errors, future errors could be reduced if there is an on-going process of 
updating aid administrators and other relevant institutional administrators as to the 
nature of the error and the means to correct it. * 



♦Although it did allow extensions for legitimate five year undergraduate programs. 
♦♦This amount includes both first payments, for which there is no institutional 
liability, and subsequent payments. 




We recommend consideration of a proposal to * 
drop the FAT as a Pell eligibility requirement ijow 
that aggregate award limits have been eased, 
except perhaps for within-year transfers. 



We also recommend that the aid administrator be 
permitted to place a "proxy" FAT in the student's 
file if a hardcopy cannot be obtained after 
reasonable effort. 



3-2^ 



47 



ERIC 



3.3 IMPLICATIONS OF THE RECOMMENDATIONS 

In this chap we have examined feasible corrective actions aimed at reducing 
* > ■* ■ * - 

specific application form data item errors and specific institutional procedure errors. 

In understanding the implications of these recommendations in terms of costs, 

benefits, and administrative requirements, it is useful to aggregate the 

recommendations according to the broad corrective actions themes that they 

represent. Specifically: 

• Targeting validation 

• Improving the, application form 

• Simplifying institutional procedures and policies 

• Putting more emphasis on the institution as the focus of quality control. 
Targeting Validation 

Recommendations were offere*l^J^target validation towards error-prone groups 
and data items. Specifically high; lifrptj-ptone groups of independent status filers, 
those with large discrepancies betweeil^ousehold size and tax exemptions, and those 
dependent students with projected tiarg^ 4rJops in their income were identified. The 
amount of error associated with i- inqwifect determination of dependency status, 
household size, and depende^^st^clfeilijnCom^ is high (estimated net overawards of $6* 
million, $3* million, and £li million rettajcfiyely) and validation appears to be the best 
way of identifying and idjjfffi 

As Volume I (Findinjrt) Jescr^eBy trali^at ion targeted at parental and independent 



student adjusted gross incqr^^ in reducing AGI error in 1982-83. 

However, this was done by y^i^tinig ffldst ^plicants. By targeting validation through 
Pre-Established Criteria and; £rr:or^ro .a similar level of error reduction 

can be achieved with a much X$v^ and students. 

Thus, it is possible t&4>ejduce the burdert 6? yaHdiation substantially below 1982-83 
levels, maintain a reduced error^l^Vel i nt par^rttai and independent student AGI, and 
decrease error associated with i'nc^ household size, and 

dependent student income throiigH\ Validation Section; In Table 3-5 we summarize 



TABLE 3-5 



; WHO SHOULDERS THE BURDEh OF THE 
$ CORRECTIVE ACTIONS? 



THEME 



GOVERNMENT 



APPLICANT 



INSTITUTION 



Target Validation 



No Change 



Decreased Burden Decreased Burden 



Improved Application Form 



No Change 



Increased Burden .Decreased Burden 



Simplification of 
Institutional Procedures 



No Change 



No Change 



Decreased Burden 



Institution as QC 



Decreased Burden 



No Change 



Increased Burden 



TO 
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th»e in burden associated with continued refinement of Pre-Established Criteria 
ant-iProne Modeling for targeting validation. 
t* 

se recommendations can be implemented for the 1985-86 award year through 
adrratm action. Selection criteria should be determined on the basis of analysis 
of cfeardata to estimate the number of first-time independent applicants who 
fall .varus age, household size, and marital status groups. These group sizes, 
comb our previous analysis of household size versus tax; exemptions and 
expecver base year income will indicate the target population size for various 
feasibiele<n criteria. 

Improvi; duplication Form - 

Severaommendations were made to reduce error before it happens by 
improving tplication form either through clarifying definitions or requesting 
clarifying iation. • This approach seems best fitted toward increjasing the 
accuracy of cation form reporting of other nontaxable income, household size, 
and the wrin postsecondary education (estimated net errors in 1982-83 of $*6 
million, 34 mi, and $24 million respectively). * 

Ttprj>aid for any reduction in error by this method is an increased burden 
on the »iic. Specifically, our recommendations are for the applicant to provide 
more rmon than is now requested. We recommend the itemization of the 
compos cnontaxable income and the names of all family members, and those 
attena jstsecondary institution. In Chapter 4 we discuss the implications of 
addit cJrifying information on forms design, arid once implemented, some 
reduft applicant burden may be achieved. 

s design for 1985-86 can still be affected by acceptance of one or more of 
the nendations. By early summer of 1984 the forms design for that year will 
hav completed. Therefore, implementing this corrective actions theme for 
198iuires early decisions by OSFA. 
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Simplification of Institutional Procedures 

We have offered recommendations to reduce institutional error associated with 
four areas— enrollment status, cost of attendance, award determination, and lack of 
financial aid transcript (FAT) for v transfer students.* While the absolute dollar error 
associated with institutional error is large, the underawards and overawards tend to 
balance out. This indicates a lacfk of institutional ability „to satisfy compliance with 
Pell Grant program regulations rather than an attempt to be non-compliant in order to 
obtain a financial advantage. As stich our recommendations are aimed at simplifying 
and clarifying procedures and policies in order to facilitate greater institutional 
compliance. 

Specific recommendations include a more structured cost of attendance formula, 
"date-certain" for determining cost of attendance and enrollment status, the reduced 
use of a FAT, and individualized payment schedules printed on each SAR.- The first 
two recommendations sacrifice some degree of Accuracy" for simplicity. For 
example, by providing a more structured cost of attendance calculation in an attempt 
to make it easier to determine cost for Pell Grant award purposes, the cost of 
attendance calculation becomes less sensitive to individual student differences. 
Similarly, the establishment of "date-certain" does not take into accourtt subsequent 
within-term changes that may have a bearing on the actual cost of education that the 
student faces. Given the magnitude of the absolute error associated with cost of 
attendance million) and enrollment status ($1*8 million) these sacrifices do not 
seem unreasonable. 

/ 

^ The individualized payment schedule on the SAR of each eligible applicant is a 
one-time programming burden placed on the application processor. However, it 
provides not only an'accuracy enhancing tool for institutions, but also allows students 
to more accurately and easily estimate the size of their Pell Grant award' pr&r to 
submitting their SAR to the financial aid of f ice. 

* Regulatory action is required for the changes affecting cost' of attendance and 
enrollment status determinations. Thus, while 198^-854? possible, it is not reasonable 
for changes to be put in place until 1985-86. Similarly programming the "payment 
schedule onto the SAR can not be achieved before 1985-86. However, it is possible to 
eliminate or modify the FAT requirements for 198^-85 through administrative action. ' 
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The Institution as the Focus of Quality Control 

In Chapter 4 we discuss more fully the range of possibilities of putting added 
emphasis on the institutional *role in quality control. The gist of the recommendations 
presented here is to make the institution responsible for maintaining '"a low, level of 
error in cost of attendance, ? enrollment status^ eligibility determination, anckaward 
calculations. The roje of the Education Department becomes one of quality assurance 
through such techniques as program reviews, audits, and standard reports to Identify 
institutions which are not maintaining high levels of quality. 
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SUMMARY OF APPLICATION AND INSTITUTIONAL 
' ERROR RECOMMENDATIONS 



APPLICATION ER3RORS 



3.1 Improper Identification of Depen- 
v dency Status 



Estimated 
Error ($ MilL) 



Overaward Underaward 



$"6*.0 



Recipients ' ^ 
Affected 



Number 



139,000 



Percent 



5.5 



Recommendations: 

• " • Expand the validation Of firsts 
time independent applicantV > 

— tighten the validation pro- 
cedures^nd documentation 
requirements for these 
applicants 

\ 



Management Aqtions; 

• i Administrative action only* 



v 



3.2 Incorrect Reporting of Other Non- 
taxable Income (including excluded 
interest/dividends/tax-f re^ ^em- 
ployment compensation arfdTa**~~ 
free capital gains) 



Recommendations: 



Estimated 
Error ($ MilL) 



Overaward Underaward 



$ 46.0 



Recipients 
Affected 



Number 



254,000 



Percent 



10.0 



To reduce confusion, specify 
sources of nontaxable income 
on form. (See also "Spjit 
Form," Chapter 4.) " 

Additional training of finan- 
cial aid administrators to detect 
oversights from tax forms. 

i 

Possibly crossmatch with other 
Federal agencies to verify cer- 
tain benefits (AFDC, Social 
Security, etc.) 



Management Actions: 

• Administrative action only. 



Incorrect Reporting of Household 
Size 



"" 1 Estimated 

; Error ($ Mill.) 
Overaward Underaward 



Recipients 
Affected 



Number 

256,000 



Percent* 
10.1 



Recommendations: 

• Clarify item definition on appli- ^ 
cation and instructions. 

• Require listing names .of house- 

■ ( hold members. (See "Split Fprm," 
' Chapter 4) 

• . Tighten validation specifications, 

: including within-year and between- 
year changes. 



Management Actions: 

• Administrative action only. 



Incorrect Reporting of Number; in 
Postsecondary Education 



Estimated 
Error ($ Mill.) 



Overaward Underaward 



$ 32.0 



$ 9.0 



?. Recipients 
Affected 



Recommendations: 

• Require lifting names of house- 
hold members. 

• Clarify issue of inclusion of 
parents. 

• / Study possible elimination of 

item (see Chapter 4). 



Number 

149,000 



Management Acti6ns: 

f Administrative action only. 



Percent 



5.9 



Item elimination would require 
legislative action. 



Incorrect Reporting of Adjusted 
Gross Income (AGI) by Parents 
and Self-Supporting Students 



Recommendations: * r 

,k ■ * ■ 

• Validat^p to ten percent of : 
applications for AGI error. 

• Specify to the extent possi- 
ble, that the Pell applica- 
tion should be filed after 
completion of the Federal tax 
form, O 



^' Estimated 
Error ($ Mill.) 



Overaward Underaward 
$26.0 



Recipients 
Affected 



Number 



Percent 



$11.0 



102,000 4 . ».0 



Management Actions: 

• Administrative, actiojFi.only. 



Incorrect Reporting of Income 
by Dependent Students 



Estimated 
Error ($ Milk) 



Overaward Underaward 

.$;13.^ :. $ 1.0 



Recipients 
Affected 



Number 



37,000 



Percent 



1.5 



Recommendati6rts: 

# * Select; for validation those < 

applicants whose projected income 
drops to less than half of/base, 
year income. ^ : - ,li . ; 

• Consider substituting a "self- 
help" expectation for dependent 
student income. 



Man^jjpment Actions: v 

• Administrative action only. 

• Requires legislative action. 
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INSTITUTIONAL ERRORS 

3.7 Incorrect Determination of Enroll- 
ment Status 



Estimated 
Error ($ Mill.) 



Overaward Underaward 



Recipients 
Affected 



$ 54.0 ' 



Number , Percent, 



*$94.0 



564,000 



22.3 



Recommendations: ; 

• Institute more frequent 

reporting of enrollment * ^ 
■ status changes. jj- - 



Simplify applicable regplations 
to reduce misunderstanding by 
setting a "date-certain" for 
enrollment status determination. 



Management' Actions: 

• The Education Department imple- 
mented "rolling" validation 
roster beginning^ith 198^-85 
processing year (see Chapter 2, 

, Rolling Corrections). 

• Requires rulemaking action. 



3.8 Incorre&t Reporting of Cost of 
Attendance 



Estimated 
Error ($ Mill.) 



Overaward Underaward 



$ 14.0 



$35.0 



Recipients 
Affected 



^Number 



273,000 



Percent 
10.8 



Recommendations: 

• Institute a more structured 
cost of attendance forrrtula. 



Management Actions: 

• Requires rulemaking action. 



Set a "date-certain" for cost 
-of attendance determination. 



3.$ Incoiyect- Award Calculation jor Dis- 
bursement' v ? ' 



ecpmrnendatiops: 



# . \* 

• 4 ^ Ah individualize payment 

* * schedule should be ir^ided 

^ in^thfe SAR for eachPCTgi- 
ble student. * • 



Estimated 
Error ($ Mill.) 



Overaward Underaward 



Recipients 
Affected 



$ 40.0 



$16.0 



Number Percent 
311,000 12.3 



Management Actions: 

• < Administrative action only.. 



3.10 No Financial Aid Transcript (FAT) 
for Transferred Students 



Recommendations: 

• Orop FAT as an eligibility 
requirement, except for 

.^withih-y ear transfers. \j 

• Allow proxy FAT. 



Estimated 
Error ($ Mill.) 



Overaward Underawar 



$ 95.0 



warc^ 



Recipients 
Aff ected 
Plumber 



, 81,300 



Management Actions: 

• Administrative action only. 



Percent 



3.2 
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CHAPTER 4 

; RECOMMENDATIONS FOR FURTHER IMPROVING 
THE DELIVERY OF PELL GRANT FUNDS 

4.1 INTRODUCTION 

The corrective actions already discussed were developed in response to the level 
and frequency of specific types of error. This is true for the prior corrective actions 
discussed in Chapter 2 and for the new recommendations provided in Chapter 3. tfhile 
the development and discussion of these current recommendations are organize*! on an* 
error^by-error basis, there were certain overall themes. 

The overall themes for application or student error are: 

. . j , ■ fl *. 

• Targeting validation in order that this remedial corrective action be made 
more cost effective 

• / Improving the application form as a preventative corrective action. 

Two themes emerge from the recommendations developed for addressing institu- 
tional error: 

• Simplification as a means of avoiding error-prone situations 
Emphasis on the institution as the focus of quality control. 

Our development of the set of recommendations described in Chapter 3 was 
constrained by at least four considerations: 

• We focused on one error at a time rather than using a more holistic 
approach . 

' - *V . 

• We avoided redefinitions of program elements and parameters 



• We did not consider recommendations that were inconsistent with program 
intent 

• We only considered the Pell Grant program. 

In this chapter we relax the above constraints and attempt to discuss delivery 
system improvements from a much broader framework or context. The remainder of 
this chapter is organized about two broad themes which encompass the themes of 
Chapter 3: 

♦ » 

• Keeping error out of the system through simplifying and improving the 
application process 

• Formalizing the role of the institution as the focus of quality control. 

*.2 RECOMMENDATIONS FOR KEEPING ERROR OUT OF THE APPLICATION 
PROCESS 

, * Many of the error-specific recommendations presented in Chapter 3 focused on 
the application process. Most of these corrective actions were preventative in nature. 
That is, they focused on keeping error out of the system. Specifically they included: 



Specifying sources of "other nontaxable. income" on the application form 
itself rather than as a worksheet in the instruction package (Recommenda- 
tion 3.2) 

Clarifying the definition of household size on the application and possibly 
requiring a list of the names of the members (Recommendation 3.3) 

Requiring the listing of the names of household members attending 
institutions of postsecondary education and clarifying the inclusion of 
school-attending parents (Recommendation 3.4) 

Encouraging the submission of the Pell application ; after the filing of 
Federal tax forms (Recommendation 3.5). . 



As already noted, thesje recommendations were developed :Using a some^at 
constraining error-by-error approach.' Moving away from this myopic approach^we 
have been able to develop four "recommendations which are broad^b&sed and dire^ed 
at the application process as a whole. In the following four subsectioV^we discuss: 

• Overall simplification of the application form (4.2.1) 
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• Modification and possible redefinition of dependency status (4.2.2) 

• , Simplification of the Family Contribution Schedule (4.2.3) 

• Improvements in the Corrections Process (4.2.4). 

All four are intended to prevent errors from entering the application process so as to 
prevent rework and duplication of effort. 

'•"til*.-: 

4.2.1 Overall Simplification of the Application Form 

Objectives Enhanced 

Accuracy 
Efficiency 
Ease of application 

Simplicity * ^ 

Ease of verification. 

Objectives Lessened 

• Cone ise application package 

• Ease of handling. 

Procedure 

Currently, once a Pell Grant applicant answers the dependency status questions 
and determines whether he/she is dependent or independent, the remaining questions 
are color-coded — green for independent and gray for dependent. Similarly, the 
instructions have colored bars along the edge of the page in order to direct students 
for proper instructions. Following this color-coded road map appears to be quite 
confusing because, for example, some parts of some questions require information 
from both dependent and independent, while other parts only require data from 
dependent applicants, or vice versa. In response to this problem the Education 
Department pilot tested a form which, once dependency status was determined, 
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directed the applicant to a completely distinct set of questions and instructions, i.e., 3 
split form. 

If a split form was adopted, the current forms package would have to be 
lengthened by a page or two to accommodate the separate instructfon sheets and the 
separation of application items. However, we believe that this spacing out of items 
and instructions qan be put to additional good use by improving the specif icatioqs for 
several critical items: 

• Other nontaxable income V : ■ 

• Household size > T 

• Number in postseqonidary, ^ 

As we explained in 3.2, it would seem advantageous to list as many of the most 
important sources of nontaxable income on the application instead of on the 
worksheet. These would include unemployment compensation, t^x-free interest, and 
other welfare benefits. This is likely to cut down on oversights for this item. 

Also, the split form would allow space .to list the names of all household 
members and to identify whether they are enrolled in postsecondary education. As we 
stated in 3.3 and 3.4, we feel that this would reduce these errors while providing a 
more substantial basis for verification. 

Recommendation We recommend that the Education Department 

develop a suitable "split form." We also recom- 
mend that 5the instructions and specifications for 
the following items be augmented: 

/ — other nontaxable income 
— . household size 

— number in postsecondary education. 

Assumptions ' 

« 

• Separating instructions for dependent students from instructions for 
independent students \^11 reduce confusion about data elements. 

• While the split form still requires self-classification, the additional space 
4 can be used to provide more instructions for the dependency status 

questions. 
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Benefi 



Household size less error-prohie? and easier- to verify 

Number in pbstsecondary education less feVror-prone and easier to verify 

Fewer errors of omission for other nontaxable income 

Improved reporting of data elements where /dependency status affects the 
definitions '; ,; .7, : > : 

Reduced dependency status Errors ' 

Easier for students to complete/application 

item, responses. 



Disadvantages 



Larger application IpaCkageV:'; 
Redundancy in instructions^ ,'■ 



^ *.2.2 

Objectives Enhanced 



• ■■ ■ Ability to verify data • ... 
4 * j * Accuracy . ; 'i'.fi- 

^Reliability . • • 

/ • - Simplicity . ^ *T 

; * Ease of application* . ! 

Objectives Lessened 



• ; 



Sensitivity - 

Family contribution precision. 



ERIC 
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Procedures 



During our study, it becarte evident how difficult it was for applicants to 
document their response to the dependency status criterion. In particular, verifying 
any of projected year criterion is extremely speculative and, even in the base year, the 
residence and support criteria are difficult to prove. Much of the corroboration, on 
these items came through interviews with the parents of the recipients, though thiols 
hardly a method that can become part of the regular validation process. What then 
can be done to improve verifiability for aid administrators and documentability for 
students? Should, for example, all the troublesome criteria be dropped from the 
definition and thereby rely solely uporf exemption criteria in the base year? 

It appears from our study that from an error-reducing standpoint, it would not be 
beneficial to drop projected year criteria or the residence and support criteria. Under 
the current definition, use of projected year criteria uncovers over 20 percent of 
dependency- ;st£tus errors (about ^ fmd, while 70 percent of all 

recipients were found to be dependent on thfc basis of all three criteria together (for 
both years), the residence and support criteria alone account for determining 22 out of 
the remaining 30 percent of truly dependent recipients. This suggests that although 
tax exemption criteria are the most comprehensive and the most easily verified, 
especially for the base year, it is not the sole determinant of dependency status. 

These findings lead us to suggest methods for improving the verifiability of the 
current criteria. One way to approach this, we feel, is by reversing the documentation 
requirements for the residence and support criteria in the base year. For the 
residence criterion, we would require the applicants to attest and to document, upon 
validation, that they maintained a residence separate from their parents for 10 or 11 
months of the year. This is a more direct residence criterion for which documentation 
such as rent receipts, leases, and mortgage payments would be concrete evidence. The 
question could be reworded as follows: * 

During the last year, have you maintained a residence separate 
from your parents for at least 10 months? 

For the support criterion, we would request that the applicant demonstrate "self- 
support" by producing tax forms, wage receipts, award letters, and other proof of 
earnings. 
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The application question would be reworded as follows: 



During the last year, have you personally provided over half of 
the resources required for your suppo^r 

<■ ' {■> ' •* < 

These new-Uown residence 11 and "self-support" criteria would both make, itr easier 

for the student to determine their /own eligibility and for, the aid administr&tdr to 

verify their responses. 

Recommendation 4.2: We recommend substituting "own residence" and 

"self support" criteria for. the current parental 
residence and support criteria as a means of 
improving the ability to document * and verify 
• : , dependency' status. v : ^>r r'-'v •■. ' 

Assumptions ;. " . '}\' : 

• r Proposed modifications will not be yiewed>/as dramatic r redefinitions -of 
dependency. ; v 

. v • : Determination of "number of months" and "proportipqoi ^ 
'V be done so as to align with stringency of the J '*f2 day^>^^$?50 support" 
' 'criteria.;-. - *• ' v \.} J , •' v.;/\ 

Benefits - : \/ 



• Ease of verification 

• „ Reduction of dependency status errors 

• Improved program integrity. 



Disadvantages 



• Confusion as to definition of separate residences 

• Increased validation burden on students. 
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*.2.3 Simplification df the Family Contribution Schedule 
Objectives Enhanced * h - '* )\ 

• Simplicity 

• Ease of verification 

• Cost efficiency ,i 

• Improved accuracy 

• Reduced paperwork 

• Reliability.. , '■ f y;T ■ . •■ , V:''''"^y 
Objectives Lessened c 

• Sensitivity 

• Cost control 
• ( * Equity. 

Procedure 

An applicant for a Pell Grant is asked for a substantial number of financial facts 
about his parents, spouse, and himself all for use in computing the Student Aid Index. 
For a dependent student that index consists of three parts — the parental contribution 
from income and assets, the student's contribution from assets, and the student's 
contribution from income; for an independent student just the last two. The 
information that is requested goes beyond even the Federal tax forms,, asking, for 
example, for nontaxable income from about 15 sources. However, not every financial 
item contributes an equal weight to the student's award. Simplification promises to, 
reduce reporting requirements by eliminating those items that have limited capacity 
:» to discriminate between eligible and ineligible applicants, or to vary award levels. At 
tjie same time, it cc^ld remove the error associated with those items and their 
potential misallb^aLtion. of program dollars. > 
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Could the complexity of the contribution schedule be reduced withgj^ehdanger- 
ing, to any significant extent, the awards of most students and the distrib^^^jal'intent^ , 
of the Pell Grc^t program? ... 



4& 



We could evaluate each item as a candidate for eUminatiorv*^^- 



of the following criteria: J 



nlnvthe b^^^^each 



I" 



Budget Impact— Budgetary impact of the retention or elimination o$' n f he- 
element from the SAI calculation. * * • 
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Rationale: Program simplification should not be used to alter nation- 
al priorities as tq who receives Pell Grant assistance and in What' 
amounts. Nor should program Simplification reduce the total P.ell 
budget beyond that realized by error reduction. 

e-i ■ ^ 

Definition: The percentage change in total program cost when the 
element is eliminated is the budget impact of that element. 

Effects: Elements with low effects are prime candidates for 
elimination because they do not alter the national priorities of Pell 
Grant assistance?. v * 

— * Low:, less than 4 percent of total program posts 

Modest: 4-10 percent of total program, costs 
High: more than 10 percent of total program costs 

Aggregate Distributional Impact— Distributional impact of retention or 
elimination on award and award amounts. * 

Rationale: Program simplification shoulci not alter current program 
targeting or the recipient pool in a significant Way. 

.Definition: The percentage shift in the distribution of .program 
^ benefits across income groups is its aggregate distribution impact., 

Effects: Elements with low effects are candidates for elimination 
because they do not appreciably change the distribution of program 
benefits across income groups. 

Low: less than a 5 percent shift in the income distribution 

— Modest: 5-10 percent shift in the income distribution 

-High: greater than a 10 percent shift in the income distribution 

\ 

Sensitivity— Sensitivity of the SAI to changes in the specific data demerit. 

Rationale: Current program sensitivity to important unusual circum- 
stances should not be altered significantly. 

- : Definition: The effect on the SAI for 90-percent of recipients' with 
that data element (excluding the 10 percent of recipients with 
extremely unusual circumstances) is its sensitivity. 



Effects: Elements with low sensitivity are candidates for elimination 
because the dollar award impact for most recipients with that data 
• - • element is small. 

•: ; V : - ^ LoW: less than $100 at the 90th percentile ; 
— Modest: $101-300 at the 90th percentile 

High: over $300 at the 90th percentile .. : 

• Reliability— Reliability or accuracy of the specific data item. D . 

Rationale: Data elements that are inherently unreliable cause pro- 
gram error, undermine equity goals, and necessitate validation dis- 
proportionate to the value of their inclusion. 

Definition: The percentage of error in initial'data collection is its 

reliability^ 

i. 

• \ ? 

Effects: ^Elements with low reliability are candidates for elimination 
because there is so much error in them. 

Low: more than 10 percent.error in collecting the item 
Modest: 5-iO percent error in collecting the item 
High: less than 5 percent error in collecting the item 

• Ease of Validation— Ease of verif ying or validating the element. 

Rationale: Data elements tha£^reSiifficult to validate are also- 
difficult to provide in the first place, and can have serious unknown, 
uncontrollable effects on the cost-effectiveness and equity of the 
progratyi. t , v 

Definition: The cost to the Federal government, the institutions, and 
' i the family of documenting reported values adequately is its ease of 

validation. 

Effects: Elements with low ease of validation are candidates for 
elimination because they are difficult to report or document 
accurately. 

f »■ 

1 — Low: relatively unavailable documentation or largely based 

upon estimates; high cost to secure documentation 
0 — Modest: relatively available, relatively complete documenta- 
tion with only minor estimation; some modest cost to secure 
documentation 

High: readily available, complete documentation of a precise 
nature; low cost to secure documentation 

Table *-l shows preliminary results of applying the scheme to data elements now 
used iri v the SAI calculation. The assignments of values to data elements is based on 
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approximate values developed fbom a review of recipient data. Final policy' decisions 
should be based on a more exhaustive review of an applicant database. K 

• •• Assumptions 

- The table is' based on preliminary estimates of effects and the 

( definitions used above. ■ \ . 

; It r^feres to the SAI calcUlatioH not the award calculation. (Social - 

Secuirty Benefits and Veterans Educational Benefits enter the award 
" . ■ calculation but not the calculation of SAI.) 

- It differentiates between data elements and application items. 
Highlights <\ % . ;; 

r v -TKe .;ranking^ ! 'ciearly show that several data elements can be elimi- 
, nated from the SAI calculation; with minimal effects. 

- . While differences in the rankings of the first seven data elements are 
smalV there is a rapid and continuous drocf in the rankings below the 
first seven elements. * 

• - Each of the nine data elements could be eliminated individually with 
minimal budget and distributional impacts. -Even if the elimination of 
all nine had a modest total impact on program cost, this could be 
easily adjusted for since individi/al distributional effects are minimal 
and probably cancel each other out to-d great extent. 

Of these nine elements only four have modest or high sensitivity to 
unu$ual circumstances and two of those have low ' reliability and are 
difficult to validate. \ - or.- 

- . The most attractive alternatives appear clearly to be the 5, 6, or 7 

element formulas. * • - 

■- 4 - • ' :j &jJ ■ ' ' ■• ) 

These broad results appear to be independent of the specific defini-;^ 
tioris used. i i 



Recommendation *.3: We recommend an evaluation of eath item in the family 

contribution schedule as to its impact on award size .and V 
distribution as well as its reliability, sensitivity, and h 
ease of validation. * * ■■■ • >. ' 



Assumptions 



• Program parameters can be adjusted to eliminate overairSudget^changes 
and to control distributional changes. ' • 



TABLE 4-1 
RANKING THE DATA ELEMENTS 



Budget Distrib. Easeol 
DATA ELEMENT Impact Impact Sensitivity . Reliability Validatk 

~ ... n . 



djusted Gross Income 


(1) 


H 


H " 


H 


• • H 


H 


.S. Taxes Paid 


(1) 


H 


s 

r 

H 


H 


H 


H 


o. of Exemptions 


(1) 


H 


H 


H 


H 


H 


on Taxable Income 


(3) 


h' 


H 


H 


M 


M 


udent/Spouse Income 


(1) 


M 


H 


H 


M 


M 


.quid Assets 


(*) 


M 


M 


H 


M 


M 


o. in P.S. Education 


(1) 


M 


M 


M 


M 


M 


edical/Dental Expenses 


(1) 


L 


L 


H 


M 


M 


nreirnbursed Tuition 


(1) 


L 


L 


M 


M 


M 


»rned Income Portions 


(2) 


L 


L 


L 


M 


M 


»rent Marital Status 


(1) 


L 


L 


L 


M 


M 


udent Marital Status 


(1) 


L 


L 


L 


M 


M 


d. Of Student's Dependents 


(1) 


L 


L 


L 


M 


M 


jme Equity 


(2) 


L 


L 


M 


, L 


L 


isiness/Farm Equity 


(2) 


L 


L 


M 


L 


L 


udent/Spouse E X P- Income 


(5) 


L 


L 


L 


L 


L 



)tes: 

Corresponding dumber of application form items is in parenthesis 
, x Estjmates based on definitions cited in the text and preliminary estimates and judgements 
A1J effects refer tp the SA1 not awards 
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Xhe Campus-Based programs can be used to account for special 
circumstances. 

It is possible to predict changes in applicant pool. * 



Benefits 



c 



• Reduced reporting burden for students/parents 

• Improved accuracy o'f data * 

• Lesser cost of processing applications including: * 

lower initial costs 
fewer corrections 

* 

^ • More tirfiely delivery of aid. 
Disadvantages 

0 

• Less sensitivity v 

• Equity changes 

• Less ability to handle special circumstances. 

b.2A Improvements in the Corrections Process 

The three recommendations developed above do not address the quality problem 
that is introduced by the corrections process since the error or payment consequences 
are not concentrated in any one data element or small set of data elements. Rather, 
error introduced in the corrections process has Consequences that cut across ^nd 
affect all application items. 

Table 4-2 indicates the . effect *>f corrections for two groups of students. 
Students not selected for validation h&d corrections which increased their eligibility 
(decreasing SAIs) in M percent ifl^the cases~£i>mpared to 9 percent with decreased 
eligibility. The results are quite different for validated students, where^the percen- 
tages are nearly reversed. Thus, abuse of the corrections process can result in higher 
a SS re S ate expenditures because of resulting increases in overpayments and over- 
awards. 
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In orcler to address the pjjoblem(s) associated with the corrections process we are 
making two recommendations: 9t 

* * . m . v 

• Establish atfirm cut-off date^for a^l corrections - y 

• Eliminate or prohibit post-validation corrections. 

Objectives Enhanced ,, ; t ' . * 



Objec 



Cost efficiency 
Accuracy • 
Timeliness 
# Reduced paperwork 
Cost, control 



Ives Lessened 



Procedures 



Increased burden on studerfts. 
" * * 

Equity 



4 



If.' 



At present, there are tforee methods of initiating corrections to original applica- 
tion data*, ©tie i$ the fairly restrictive process of sAmitting a Special Condition 
Application under specified situations felt to identify thosg applicants who h|ye 
experienced 1 a significant change of dtrdfii nuances subsequent to the initial application 



submission. 



The second is the Corrections Application," in reality only a resubmission of tlte 

.1 «. . . 

original application which could not be processed. ' This route can only be initiated by 

▼ 4k , jS ft 

the processor, not by the applicant, and thus does not seem to present any additional 

problem to student error, beyond the normal.limitations of the appKcation*itself. 

*S , * 

4. 
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TABLE 1-2 



SAI CHANGES INTRODUCED THROUGH THE 
CORRECTIONS PROCESS 



Randomly 
Selected and 
Validated 



Percent Increasing SAI 



Percent Decreasing SAI 



18% 



0 
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The* third method is the most frequently used one— the submission of corrections 
to the Student Aid Report (SAR). There are several legitimate reasons that students 
.submit corrections to the SAR: 

• To correct accidental misstatements of fact by the applicant at the time 
of original submission resulting from a misunderstanding of what was being 

4 requested that is now, upon review of the SAR, more w evident even without 
edit messages % 

• To correct misreporting rStfmhg from incomplete information at the time 
of submission— identified by the applicant 

• To correct data entry errors— the proper data were reported, but were 
miskeyed or misread mechanically 

• To clarify what was reported earlier— incomplete or inaccurate data 
identified by the edit process and confirmation or correction requested via 
SAR messages. 

In theory, Pell Grant applicants are not allowed to\make adjustments which would 
reflect changes in their circumstances occurring after submission of the initial form, 
(except through a Special Condition Application). The problem is that it is impossible 
to separate intentional change from necessary corrections. The paradox is that an 
applicant may not "change" his/her application but he/she can "correct" it throughout 
the year. As a result there is no way to readily control or limit the number of 
applicant changes which are not legitimate while not penalizing other applicants who 
have corrections to make. - . * 

We would recommend that any changes which are made to the initial Student Aid 
Report must be certified by a financial aid administrator before being sent to the 
processor for correction. If, after an applicant deceives his first S/U?., «he notices 
errors they should be noted ^nd submitted by meeting with an aid admmis.trator,^ in 
keeping with our other recommendations, we woul^ suggest instituting 0 a cutoff date 
for corrections. This date could correspond with thefemrollment status or cost of 
attendance date-certain (see 3.7 and 3.8) or it ccaitd^De the date of a student's 
validation, -whichever came later in the term. Tying i^to some date by* which the 
student will have had the opportunity to discuss the situation with the aid ajdministra- 
tor should assure that any items, to be corrected will be checked before resubmission. 
For validated students, no corrections should be permitted after validation during that 
term. k ** « 
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Recommendation 4.4: We would recommend establishing a cutoff date 

for student-initiated corrections for all appli- 
cants. For validated applicants, no further 
^ corrections woyld be permitted after validation. 



Assumptions 



Initial errors can be corrected before the cut-off date. 
Cut-off dates need to take account of calendar differences. 

■ 4t ■ * • 



Benefits 



• Reduced program error resulting from abuses tS the corrections 
process 

• Lower processing costs because of reduction in corrections 

• Measured program integrity. 



Disadvantages 

• Lessened sensitivity 

• Increased student burdera 

• Increased institutional burden 

* *> 

4.3 FORMALIZATION OF THE ROLE OF THE INSTITUTION IN QUALITY 
CONTROL * ^ 

The recommendati<?ns as^pciated with specific institutional errors discussed in 
Chapter 3 are based on two underlying themes: * 

• Simplifying institutional processes associated with determinations, verifi- 
cations, and calculations <^ 

• Emphasizing the role of the institution as the focal point of quality control. 

.* ' 

These two themes were used to develop the specific recorrtmendatipns presented 
in Chapter 3. These recommended corrective actions were tempered by the following 
considerations: . 
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Dealing with a single error at a time . 

Not redefining any key program elements * 

\\ ■ . ^ • , » . * ■' 
Preserving program intent 

Restricting certification to the Pell Grant program/ 



Specifically, we recommended: 



4' 



Amending enrollment status; regulations to reduce misunderstanding t>y 
setting a "date-certain", for enrollment status changes ■} . «; 0 

Instituting a more structured cost of attendance formula and establishing a 
"date-certain" for cost Qf attendance determination ? . / % 

Providing an individualized "pay ment schedule directly on th^ S^R foj-^eacrt 
eligible student ' 



9 
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Eliminating the requirement for the financial aid transcript (FAT), except 
for within-year transfers and allowing proxies where hardcopy transcripts 
are not available. 4 • 1 " ■ ; r« c \ 



In order to address the larger issues , associated 
processes we are providing a recommendation, aimed at: 



overal; 



utional 



Formalization of the institution's .respo^ibility for quality 



4.4.1 Formalization of the Institution as the Focal \ Point fi 



Objectives Enhanced 



Efficiency 
.Ljracy 



,, Accountability' ."V, ' . * '-' 
^h^i^tiona^fetonom^ v ^ 

Reliability!, . .;' w 

a"; Si 



rfi' ■■;#" • ;''f 
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ty 





•'. . i 
fed 



Objectives Lessened 



Federal cost control 
Administrative burden. 



Procedure 



Quality arid , accuracy in the Pell Grant program must be •^.^.(^r^isMr'at .-^bg 
v points where the. services are provided. The Federal govern 

establish quality in what is essentially an institutionally admin^^^^rQgram^ 
.v theme of making" quality the responsibility of the production org^^ratuJb is a 
■ thread which rifos throughout industrial quality control* It is vafjptiq 

that you cannot Inspect quality into a unity qualit^&ust be bu^t M? 



The ^edera^ governmepf i^izes this approach to quality jppntr^^^pfie Aid to' 



Families witjfc DeperWent Children ( AFDG), Fao<J Stamps, and M 
threfet- bf these programs J^e^falhtly. administered by the' $t 

government; \ While the exact split differs the state goy^ti 

"-'"ftp j. ■ v- :. • » ■ ? ;■■ V- '. >* ■ 

the responsibility' c >for quality, in these programs With <] 

- ; ^ft a&lishing fairly b r r oad r equi r #n<ents.|^ 



^a^programs. All. 
tfhe Federal 
$ generally given" 
ederal government 




<■ : Current pralcticfe ifi the Pell C^ant pro-am !is lor the Federal government to < 
tak^;tesponsibiUty^ The Federal governme^^ftempts to improve quality 

•through the f /e?lit^V "comrnents," and "reject" scherrofirtised in the application 

;bn and procedures are cucrently 



f 



^processing sof t$$^& i sy stem ^ Validation s 
/ dictated /"by^thfti^^fal gpV(lr*t^ent. 

.^^/ y^^V'^^^^^M approach t^ quality control in- the/J^gll drant program, may not be 
appropriate because of $w& issues: 



'1 



' *Advanqed Technplo^i Inc4 An Analysis of Quality Control Regulations for Selected 
Federal- Entitlement- ft&graEns t November 1983. 
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• Quality problems (or errors) may best be identified and addressed at the 
local, level where more information is available to the Financial Aid 
Administrator, 

• Incentives for improving quality (reducing errors) are not provided to the 
institutions. 



A move toward making the institution the focal point of quality control would 
address both of these issues. to * 

Trae Federal government can make the institution the focal point for quality 
control x^y establishing quality control regulations for all student financial aid 
programs. In addition, the Department should establish quality incentives and provide 
technical assistance to schools. Thus, there is a three-prong approach to making the 
institution the focal point of quality control; 

' ^ 

• Regulations 

• Incentives 

• Technical assistance. ^ 

1 ' ,; ♦ - - 

c '/ The regulations would establish the requirement that institutions have an 

approved quality control plan developed in accord with minimal Federal standards. 

Thd'jH&ri r&4§t represent a comprehensive scheme to control error, fraud, and abuse. 

The institution would be allowed wide discretion in designing their system as long as 

the methods and procedures could reasonably be expected to control error and promote 

quality^? OSF A is currently soliciting opinions on a quality control regulation for the 

Campus-Based and Guaranteed Student Loans programs. This regulation involves the 



ranteea 
imple of 



selection of a random sample of cases in order to estimate the institution's error rate. 
The^evel of the error rate dictates the number of cases the institution must review- in 
order to meet desired levels of quality. In such a scheme tti$ institution has discretion 
in establishing its quality control system, while the Federal government specif ies thfe 
desired quality levels. > . 

The incentives could be tied to the administrative allowance granted to 
institutions. A school whose error rate was significantly above national norms would 
receive a lower allowance. Schools with exemplary error rates would be granted 
higher administrative allowances. Schemes of this nature are used in Federal 
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entitlement programs such as the AFDC and Food Stamps programs. In these 
programs administrative allowances are. adjusted depending on the relationships 
between the state f s error rate and either the national error rate or a specific numeric 
standard. 

In the Campus-Based/GSL regulations under consideration by the Department the 
institutions are provided incentives for improving quality because the number of cases 
the institution needs to review decreases as quality improves. The institution is also 
allowed to select these review cases using the most effective techniques possible. 

The Federal government technical assistance would take three forms: 

• Development and dissemination of a quality control handbook for institu- 
tions 

• Inclusion of quality control modules in training programs 

• Provision of quality control specialists to assist schools in improving 
quality. 

The Division of Quality Assurance (DQA) is currently developing a handbook 
entitled Quality Control in the Institutional Delivery of Student Financial Assistance . 
This cnanual addresses the following topics in a nontechnical manner: 

• Establishment of a Quality Control Program 

• Design of a Quality Control Program 

• Implementation and Operation of a Quality Control Program 

• Evaluation and Enhancement of a Quality Control Program. 

e ln addition to its role of facilitation through the provisions of regulations, 
.incentives, and, technical assistance, the Federal government should take the le&d in 
'quality assurance. The Department should perform audits, externally assess quality 
levels, and monitor the quality control activities of the institution^., Thus, quality 
control will be the responsibility of the institution but the Department will provide the 
assurance that institutions are actually carrying out and accepting^ this responsibility. 
These distinct roles and responsibilities should be clearly del|neated in the regulations. 



Recommendation 4.5: the Department of Education should establish the 

institution as the quality 0 control focal point by 
developing regulations, providing incentives, and 
providing technical assistance. In addition, the 
, Department should assume the quality assurance 
function. 



Assumptions 



Benefits 



Instituting up-front, preventative quality cpntrol at the institutional level 
is cost-efficient. . • » ' 

Acknowledged base exists which can be modified for campus utilization. 



Aligning responsibility for quality with the providers of service 
Reducing error • 
More timely processing 
Less Federanoyolvement 
Increased institutional autonomy. 0 



Disadvantages 



• More burden on institutions 

• Knowledge gap at campus level. 



